235 commits

Author	SHA1	Message	Date
Nicola Murino	4ab2e4088a	CI docker: remove armv7 support ... building docker images now takes too long and often fails with random errors. I have to restart the build several times to be able to push the images to docker hub and gcr	2021-09-27 10:25:21 +02:00
Nicola Murino	da0ccc6426	add SMTP support ... it will be used in future update to add email sending capabilities	2021-09-26 20:25:37 +02:00
Nicola Murino	da5a061b65	add basic REST APIs for data retention ... Fixes #495	2021-09-25 12:20:31 +02:00
Nicola Murino	6ea38188e8	minor fixes and doc improvements	2021-09-18 10:50:17 +02:00
Nicola Murino	5c34d814d6	fix a possible nil pointer dereference ... it can happen by upgrading from very old versions	2021-09-11 14:19:17 +02:00
Nicola Murino	0eca4f1866	update deps	2021-09-08 12:29:47 +02:00
Nicola Murino	374de07c7b	update deps	2021-09-04 13:30:23 +02:00
Nicola Murino	8a4c21b64a	add builtin two-factor auth support ... The builtin two-factor authentication is based on time-based one time passwords (RFC 6238) which works with Authy, Google Authenticator and other compatible apps.	2021-09-04 12:11:04 +02:00
Nicola Murino	be3857d572	dataprovider: add timestamp fields for users and admins	2021-08-19 15:51:43 +02:00
Nicola Murino	5a549a88fe	update to Go 1.17	2021-08-18 14:39:56 +02:00
Nicola Murino	fe953d6b38	REST API: add support for API key authentication	2021-08-17 18:08:32 +02:00
Nicola Murino	ced2e16f41	add support for password validation rules ... Fixes #494	2021-08-06 18:56:07 +02:00
Nicola Murino	a3c087456b	ftpd: add some security checks	2021-08-05 18:38:15 +02:00
dependabot[bot]	9541843ff7	Bump github.com/shirou/gopsutil/v3 from 3.21.6 to 3.21.7 (#491) ... Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.21.6 to 3.21.7. - [Release notes](https://github.com/shirou/gopsutil/releases) - [Commits](https://github.com/shirou/gopsutil/compare/v3.21.6...v3.21.7) --- updated-dependencies: - dependency-name: github.com/shirou/gopsutil/v3 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-08-02 10:11:09 +02:00
Nicola Murino	7640612a95	update deps	2021-07-31 10:22:38 +02:00
mmcgeefeedo	3ae8abda9e	sftpd: add folder prefix middleware	2021-07-29 00:32:55 +02:00
Nicola Murino	a7313e4492	webdav: add new test cases and fix some lock related issues ... Our net/webdav branch now include the following patches: https://github.com/golang/net/pull/92 https://github.com/golang/net/pull/93 https://github.com/golang/net/pull/94	2021-07-25 09:55:14 +02:00
Nicola Murino	ae8ccadad2	users API: add API to create, delete, rename files and directories	2021-07-23 10:19:27 +02:00
Nicola Murino	c900cde8e4	notifiers plugin: add settings to retry unhandled events	2021-07-20 12:51:21 +02:00
Nicola Murino	13183a9f76	deps cleanup	2021-07-17 15:42:59 +02:00
Nicola Murino	6d313f6d8f	expose KMS as plugin	2021-07-16 18:22:42 +02:00
Nicola Murino	776dffcf12	kms: improve modularity	2021-07-13 21:17:21 +02:00
Nicola Murino	bd5191dfc5	add experimental plugin system	2021-07-11 15:26:51 +02:00
Nicola Murino	302ec2558c	add notifications for mkdir/rmdir	2021-07-03 18:07:55 +02:00
Nicola Murino	04001f7ad3	FTP: try to return more specific error codes/messages for some errors ... We now return 552 code for quota exceeded errors and 553 in the following cases: - filename denied by a filter - no upload permission - no overwrite permission - pre upload hook error Fixes #442	2021-06-28 19:40:04 +02:00
Nicola Murino	076b2f0ee0	modules: add v2 support	2021-06-26 07:31:41 +02:00
Nicola Murino	0c2640bbab	update deps	2021-06-19 09:56:49 +02:00
Nicola Murino	47ebe42375	FTP: fix LIST on files	2021-06-15 06:38:56 +02:00
Nicola Murino	d992f0ffcc	update deps	2021-06-13 08:54:22 +02:00
Nicola Murino	43182fc25e	OpenAPI: add users API ... These new APIs match the web client features. I'm aware that some API do not follow REST best practises. I want to avoid things likes "/user/folders/<path>" where "path" must be encoded and making it optional create issues, so I defined resources as query parameters instead of path parameters	2021-06-05 16:07:09 +02:00
Nicola Murino	423d8306be	webclient: allow to download multiple files as zip	2021-05-30 23:07:46 +02:00
Nicola Murino	3b46e6a6fb	add support for a global temp path ... Fixes #436	2021-05-27 15:38:27 +02:00
Nicola Murino	402947a43c	update deps	2021-05-22 10:42:30 +02:00
dependabot[bot]	b415e4d98f	Bump github.com/lib/pq from 1.10.1 to 1.10.2 (#429) ... Bumps [github.com/lib/pq](https://github.com/lib/pq) from 1.10.1 to 1.10.2. - [Release notes](https://github.com/lib/pq/releases) - [Commits](https://github.com/lib/pq/compare/v1.10.1...v1.10.2) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-17 09:27:16 +02:00
Nicola Murino	019b0f2fd5	http cookie: add max-age and samesite ... update deps too	2021-05-16 09:13:00 +02:00
Nicola Murino	f59f62317e	sftpd: fix file upload resume detection ... WinSCP does not set the APPEND flag while resuming a file upload, so we detect a file upload resume if the TRUNCATE flag is not set. The APPEND flag is now ignored. Fixes #420	2021-05-15 08:39:01 +02:00
Nicola Murino	0540b8780e	redact credentials within hooks ... go-retryablehttp does not redact credentials, so we still log them when we use it https://github.com/hashicorp/go-retryablehttp/pull/133	2021-05-12 22:44:17 +02:00
dependabot[bot]	f1b998ce16	Bump github.com/otiai10/copy from 1.5.1 to 1.6.0 (#414) ... Bumps [github.com/otiai10/copy](https://github.com/otiai10/copy) from 1.5.1 to 1.6.0. - [Release notes](https://github.com/otiai10/copy/releases) - [Commits](https://github.com/otiai10/copy/compare/v1.5.1...v1.6.0) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-10 14:02:09 +02:00
dependabot[bot]	aaa758e978	Bump github.com/minio/sio from 0.2.1 to 0.3.0 (#412) ... Bumps [github.com/minio/sio](https://github.com/minio/sio) from 0.2.1 to 0.3.0. - [Release notes](https://github.com/minio/sio/releases) - [Commits](https://github.com/minio/sio/compare/v0.2.1...v0.3.0) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-10 11:34:01 +02:00
dependabot[bot]	716946a148	Bump github.com/aws/aws-sdk-go from 1.38.35 to 1.38.36 (#413) ... Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.38.35 to 1.38.36. - [Release notes](https://github.com/aws/aws-sdk-go/releases) - [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md) - [Commits](https://github.com/aws/aws-sdk-go/compare/v1.38.35...v1.38.36) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-10 11:10:58 +02:00
Nicola Murino	23d9ebfc91	add a basic front-end web interface for end-users ... Fixes #339 #321 #398	2021-05-06 21:35:43 +02:00
dependabot[bot]	5c99f4fb60	Bump github.com/shirou/gopsutil/v3 from 3.21.3 to 3.21.4 (#406) ... Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.21.3 to 3.21.4. - [Release notes](https://github.com/shirou/gopsutil/releases) - [Commits](https://github.com/shirou/gopsutil/compare/v3.21.3...v3.21.4) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 14:44:07 +02:00
dependabot[bot]	2263c7e20f	Bump github.com/hashicorp/go-retryablehttp from 0.6.8 to 0.7.0 (#405) ... Bumps [github.com/hashicorp/go-retryablehttp](https://github.com/hashicorp/go-retryablehttp) from 0.6.8 to 0.7.0. - [Release notes](https://github.com/hashicorp/go-retryablehttp/releases) - [Commits](https://github.com/hashicorp/go-retryablehttp/compare/v0.6.8...v0.7.0) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 14:43:53 +02:00
dependabot[bot]	515b2d917e	Bump github.com/fclairamb/ftpserverlib from 0.13.0 to 0.13.1 (#404) ... Bumps [github.com/fclairamb/ftpserverlib](https://github.com/fclairamb/ftpserverlib) from 0.13.0 to 0.13.1. - [Release notes](https://github.com/fclairamb/ftpserverlib/releases) - [Commits](https://github.com/fclairamb/ftpserverlib/compare/v0.13.0...v0.13.1) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 13:29:54 +02:00
dependabot[bot]	af4723356d	Bump github.com/lestrrat-go/jwx from 1.1.7 to 1.2.0 (#403) ... Bumps [github.com/lestrrat-go/jwx](https://github.com/lestrrat-go/jwx) from 1.1.7 to 1.2.0. - [Release notes](https://github.com/lestrrat-go/jwx/releases) - [Changelog](https://github.com/lestrrat-go/jwx/blob/main/Changes) - [Commits](https://github.com/lestrrat-go/jwx/compare/v1.1.7...v1.2.0) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 13:29:16 +02:00
dependabot[bot]	068dd34a38	Bump github.com/aws/aws-sdk-go from 1.38.25 to 1.38.30 (#402) ... Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.38.25 to 1.38.30. - [Release notes](https://github.com/aws/aws-sdk-go/releases) - [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md) - [Commits](https://github.com/aws/aws-sdk-go/compare/v1.38.25...v1.38.30) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 11:41:25 +02:00
dependabot[bot]	b16a5c2caf	Bump github.com/go-chi/chi/v5 from 5.0.2 to 5.0.3 (#401) ... Bumps [github.com/go-chi/chi/v5](https://github.com/go-chi/chi) from 5.0.2 to 5.0.3. - [Release notes](https://github.com/go-chi/chi/releases) - [Changelog](https://github.com/go-chi/chi/blob/master/CHANGELOG.md) - [Commits](https://github.com/go-chi/chi/compare/v5.0.2...v5.0.3) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-05-03 11:41:09 +02:00
Nicola Murino	7778716fa7	update crypto and net dependencies	2021-04-25 18:12:02 +02:00
dependabot[bot]	77476d0f56	Bump github.com/aws/aws-sdk-go from 1.38.21 to 1.38.25 (#394) ... Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.38.21 to 1.38.25. - [Release notes](https://github.com/aws/aws-sdk-go/releases) - [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md) - [Commits](https://github.com/aws/aws-sdk-go/compare/v1.38.21...v1.38.25) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-04-25 17:07:59 +02:00
dependabot[bot]	c7a1fc2996	Bump cloud.google.com/go/storage from 1.14.0 to 1.15.0 (#392) ... Bumps [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) from 1.14.0 to 1.15.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/master/CHANGES.md) - [Commits](https://github.com/googleapis/google-cloud-go/compare/spanner/v1.14.0...spanner/v1.15.0) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-04-25 17:07:36 +02:00
dependabot[bot]	e7d8e73be8	Bump github.com/lib/pq from 1.10.0 to 1.10.1 (#391) ... Bumps [github.com/lib/pq](https://github.com/lib/pq) from 1.10.0 to 1.10.1. - [Release notes](https://github.com/lib/pq/releases) - [Commits](https://github.com/lib/pq/compare/v1.10.0...v1.10.1) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2021-04-25 17:07:26 +02:00
Nicola Murino	bc88503f25	sql providers: reuse the same context where appropriate	2021-04-19 18:58:53 +02:00
Nicola Murino	112e3b2fc2	add rate limiting support	2021-04-18 12:31:06 +02:00
Nicola Murino	4b98f37df1	back to development	2021-04-10 09:40:02 +02:00
Nicola Murino	b389f93d97	allow to select sha256-simd using an env var	2021-04-07 16:25:58 +02:00
Nicola Murino	74e0223eb9	remove sha256-simd usage ... sha256-simd is now deprecated https://github.com/minio/sha256-simd/issues/58 This could slow down sha256 computation on some CPU	2021-04-05 18:23:40 +02:00
Nicola Murino	0823928f98	allow to disable login filesystem checks ... SFTPGo requires that the user's home directory, virtual folder root, and intermediate paths to virtual folders exist to work properly. If you already know that the required directories exist, disabling these checks will speed up login.	2021-04-05 17:57:30 +02:00
Nicola Murino	fdf3f23df5	allow to disable some hooks on a per-user basis ... This way you can, for example, mix external and internal users	2021-04-04 22:32:25 +02:00
Nicola Murino	a43854ae9b	OpenAPI: document that secrets are automatically encrypted before saving	2021-03-28 11:23:06 +02:00
Nicola Murino	5f49af1780	external auth: allow to inspect and preserve an existing user	2021-03-26 15:19:01 +01:00
Nicola Murino	6bc5c64a3a	webdav: ignore path, perm and not exist errors in PROPFIND ... Fixes #340	2021-03-24 13:32:20 +01:00
Nicola Murino	70e035315e	data provider: add CockroachDB support	2021-03-23 19:14:15 +01:00
Nicola Murino	800e64404b	update deps	2021-03-22 08:55:35 +01:00
Nicola Murino	67ea75cf03	improve OpenAPI schema so it is better rendered on Stoplight	2021-03-07 18:41:56 +01:00
Nicola Murino	055506e518	sftpfs: add an option to disable concurrent reads	2021-03-06 15:41:40 +01:00
Nicola Murino	88122ba2f8	update jwtauth to v5	2021-03-05 18:50:45 +01:00
Nicola Murino	ad07fc78eb	update nfpm and deps	2021-03-03 18:39:58 +01:00
Nicola Murino	534b253c20	WebDAV: improve TLS certificate authentication ... For each user you can now configure: - TLS certificate auth - TLS certificate auth and password - Password auth For TLS certificate auth, the certificate common name is used as username	2021-03-01 19:28:11 +01:00
Nicola Murino	a6e36e7cad	FTP: improve TLS certificate authentication ... For each user you can now configure: - TLS certificate auth - TLS certificate auth and password - Password auth For TLS auth, the certificate common name must match the name provided using the "USER" FTP command	2021-02-28 12:10:40 +01:00
Nicola Murino	4b2edff6dd	update deps	2021-02-24 22:27:52 +01:00
Nicola Murino	8cc2dfe5c2	update pkg/sftp ... we don't need my branch anymore now that all the required features for the sftpfs are available upstream too	2021-02-22 16:27:45 +01:00
Nicola Murino	49830516be	squash database migrations and remove compat code	2021-02-22 08:37:50 +01:00
Nicola Murino	1129a868a5	Improve powershell completion ... cobra 1.1.3 has much better powershell support	2021-02-13 09:10:35 +01:00
Nicola Murino	6a6e8fffbc	web hooks: improve resilience by adding a configurable retry ... the retryable http client is used for hooks that notify events	2021-02-12 21:42:49 +01:00
Nicola Murino	51f110bc7b	sftpd: add statvfs@openssh.com support	2021-02-11 19:45:52 +01:00
Nicola Murino	05ae0ea5f2	config: fix bindings backward compatibility	2021-02-06 09:53:31 +01:00
Nicola Murino	fc9082c422	webdav: try to handle HEAD for collection too ... The underlying golang webdav library returns Method Not Allowed for HEAD requests on directories: https://github.com/golang/net/blob/master/webdav/webdav.go#L210 let's see if we can workaround this inside SFTPGo itself in a similar way as we do for GET. The HEAD response will not return a Content-Length, we cannot handle this inside SFTPGo. Fixes #294	2021-02-03 22:36:13 +01:00
Nicola Murino	78bf808322	virtual folders: change dataprovider structure ... This way we no longer depend on the local file system path and so we can add support for cloud backends in future updates	2021-02-01 19:04:15 +01:00
Nicola Murino	820169c5c6	windows service: simplify code ... update testify to 1.7.0 too	2021-01-21 19:07:13 +01:00
Nicola Murino	778ec9b88f	REST API v2 ... - add JWT authentication - admins are now stored inside the data provider - admin access can be restricted based on the source IP: both proxy header and connection IP are checked - deprecate REST API CLI: it is not relevant anymore Some other changes to the REST API can still happen before releasing SFTPGo 2.0.0 Fixes #197	2021-01-17 22:29:08 +01:00
Nicola Murino	aa40b04576	update deps	2021-01-05 12:40:49 +01:00
Nicola Murino	72b2c83392	defender: allow hot-reloading for safe and block lists	2021-01-04 17:52:14 +01:00
Nicola Murino	173c1820e1	Go 1.15 is now required ... VerifyConnection is not available in 1.14	2021-01-03 17:25:24 +01:00
Nicola Murino	037d89a320	add support for a basic built-in defender ... It can help to prevent DoS and brute force password guessing	2021-01-02 14:05:09 +01:00
Nicola Murino	3c16a19269	FTP: update ftpserverlib ... fixes another sneaky bug	2020-12-28 09:22:52 +01:00
Nicola Murino	b3c6d79f51	FTP: add support for ASCII transfer mode ... the default remain binary, a client have to explicitly request an ASCII transfer	2020-12-27 09:48:56 +01:00
Nicola Murino	2a95d031ea	FTP: add support for AVBL command	2020-12-25 11:14:08 +01:00
Nicola Murino	1dce1eff48	improve FTP support ... - allow to disable active mode - allow to disable SITE commands - add optional support for calculating hash value of files - add optional support for the non standard COMB command	2020-12-24 18:48:06 +01:00
Nicola Murino	c69d63c1f8	add support for multiple bindings ... Fixes #253	2020-12-23 16:12:30 +01:00
Nicola Murino	65e6d5475f	update ftpserverlib to include the latest fixes and features	2020-12-18 08:49:32 +01:00
Nicola Murino	15609cdbc7	fix build on FreeBSD ... see https://github.com/otiai10/copy/pull/36	2020-12-17 14:46:31 +01:00
Nicola Murino	f876c728ad	add support for the latest ftpserverlib and azblob versions	2020-12-17 13:40:36 +01:00
Nicola Murino	a6985075b9	add sftpfs storage backend ... Fixes #224	2020-12-12 10:31:09 +01:00
Nicola Murino	ab1bf2ad44	update deps	2020-12-06 22:20:53 +01:00
Nicola Murino	4a88ea5c03	add Data At Rest Encryption support	2020-12-05 13:48:13 +01:00
Nicola Murino	634b723b5d	add KMS support ... Fixes #226	2020-11-30 21:46:34 +01:00
Nicola Murino	5d789a01b7	update pkg/sftp ... These patches are now merged upstream: https://github.com/pkg/sftp/pull/392 https://github.com/pkg/sftp/pull/393	2020-11-18 19:06:12 +01:00
Nicola Murino	ca0ff0d630	add a File interface so we can avoid to use os.File directly	2020-11-17 19:36:39 +01:00
Nicola Murino	969b38586e	update pkg/sftp to fix requests accumulation ... Include this patch: https://github.com/pkg/sftp/pull/393 to avoid request accumulation (no underlying fd) if we return an error. Before this patch the accumulated requests are released only when the client disconnects. We use our fork for now to include https://github.com/pkg/sftp/pull/392 too	2020-11-16 19:49:26 +01:00
Nicola Murino	e3eca424f1	web admin: allow both allowed and denied extensions/patterns for a dir ... this fix a regression introduced in the previous commit	2020-11-16 19:21:50 +01:00