416 commits

Author	SHA1	Message	Date
Nicola Murino	f9eadd7f04	API data retention check: send CSV reports for email notifications ... replace the HTML email with the same CSV report used in the event manager Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-28 18:37:32 +02:00
Nicola Murino	04dc97072b	eventmanager: add metadata check ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-26 19:00:34 +02:00
Nicola Murino	ddda0b5ece	SQLite provider: remove code only used for shared providers ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-25 20:29:43 +02:00
Nicola Murino	76e89d07d4	add support for inter-node communications ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-25 19:48:55 +02:00
Nicola Murino	a538255034	httpclient: add leaf certificates ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-23 17:49:42 +02:00
Nicola Murino	6c7b3ac5bb	oidc: update user after token refresh ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-22 08:30:22 +02:00
Nicola Murino	bd294bb3cf	WebAdmin: allow to simplify the user page ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-21 19:36:08 +02:00
Nicola Murino	7349598b19	command hooks: allow to pass custom arguments ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-20 13:58:44 +02:00
Nicola Murino	f19691250d	zip downloads: make zip entries relative to the current dir when possible ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-19 17:06:42 +02:00
Nicola Murino	554a1cb1f4	back to development ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-18 13:08:48 +02:00
Nicola Murino	e58709c822	WebAdmin: allow to specify quota and upload size in human format ... For example 1 GB Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-14 21:18:32 +02:00
Nicola Murino	5eca73a399	give some hints if we fail to load HTML templates ... Fixes #986 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-14 12:25:19 +02:00
Nicola Murino	ea3c1d7a3b	WebAdmin: allow to pre-select groups on add user page ... The admin will still be able to choose different groups Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-13 18:04:27 +02:00
Nicola Murino	a40fa93d7b	CI: use the shortened 8-digit commit hash everywhere ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-08 13:44:14 +02:00
Nicola Murino	4498bbf2e4	CI: use Docker to build x86_64 Linux packages ... therefore Linux packages are compiled with Docker for all supported architectures Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-08 09:42:36 +02:00
Nicola Murino	3ebdfa9b2d	data providers: allow to disable SNI for TLS connections ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-07 14:31:50 +02:00
Nicola Murino	3e5cf56460	eventmanager: add data retention reports ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-06 19:09:23 +02:00
Nicola Murino	c2a65a9a74	http actions: add multipart support ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-09-03 16:29:07 +02:00
Nicola Murino	3267a50ae3	MFA: allow recovery codes only if two-factor auth is enabled ... Fixes #965 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-31 09:29:39 +02:00
Nicola Murino	da03f6c4e3	eventmanager commands: allow to pass custom arguments ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-30 12:37:18 +02:00
Nicola Murino	56bf51277c	eventmanager placeholders: add StatusString and ErrorString ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-29 19:03:31 +02:00
Nicola Murino	37d98ca290	users: add a setting to set the default expiration for shares ... Fixes #960 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-28 14:41:42 +02:00
Nicola Murino	9473dc3937	WebAdmin: fix saving email event actions without attachments ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-22 20:17:45 +02:00
Nicola Murino	6777008aec	eventmanager: allow to add attachments to email actions ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-22 19:04:17 +02:00
Nicola Murino	3e8254e398	fs actions: add first upload/download ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-21 19:01:08 +02:00
Nicola Murino	9ddd2d3588	eventmanager: add path exists filesystem action ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-20 14:13:43 +02:00
Nicola Murino	57935f585c	eventmanager: allow to execute fs actions based on schedules ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-19 15:04:00 +02:00
Nicola Murino	2b463d61e3	use epoch timestamp instead of current timestamp for unknown modification times ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-16 17:59:13 +02:00
Nicola Murino	ced4206c5f	allow cross folder renaming if the underlying resource is the same ... this was only allowed for the local filesystem before this change Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-15 21:39:04 +02:00
Nicola Murino	c86db09cd8	event manager: add Certificate renewal trigger ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-12 17:37:29 +02:00
Nicola Murino	194c3c13ac	event manager: add IP blocked trigger ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-11 20:09:53 +02:00
Nicola Murino	526f6e0f6b	cloud storage providers: remove head bucket requests ... let's just assume the bucket exists on "stat" requests for the "/" path Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-11 08:31:51 +02:00
Nicola Murino	a61211d32c	OIDC: allow to get the role field from a sub-struct ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-10 21:42:58 +02:00
Nicola Murino	4cd340e07f	eventmanager: add support for filesystem actions ... Fixes #931 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-10 18:41:59 +02:00
Nicola Murino	890dde0e00	back to development ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-05 18:48:58 +02:00
Nicola Murino	b1efe8d0b5	eventmanager: add support for data retention checks ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-04 21:50:38 +02:00
Nicola Murino	fdc10aa6c7	CORS: add support for more parameters ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-02 18:44:34 +02:00
Nicola Murino	455bb550ee	azblob: fix SAS URL with embedded container name ... Fixes #944 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-01 21:32:40 +02:00
Nicola Murino	9d2b5dc07d	refactor: move eventmanager to common package ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-08-01 18:48:54 +02:00
Nicola Murino	3ca62d76d7	back to development ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-30 10:07:09 +02:00
Nicola Murino	ef0a3bc571	add support for anonymous users ... Fixes #935 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-27 18:54:25 +02:00
Nicola Murino	ec5da8b4a5	ftpd: allow to require TLS on a per-user basis ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-26 18:51:39 +02:00
Nicola Murino	a2e73228d2	initprovider: don't execute actions ... we are not running as service here Fixes #932 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-23 19:38:15 +02:00
Nicola Murino	1470018054	web UI: allow to enable OIDC login and/or login forms ... any combination is now supported Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-22 20:55:33 +02:00
Nicola Murino	e6bfbcd489	OIDC: allow to debug the received id_token ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-22 11:11:35 +02:00
Nicola Murino	a0bbcf6ebb	web client: add HTML5 player ... See #914 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-21 18:42:22 +02:00
Nicola Murino	d5946da1e2	OIDC: allow to enable only OIDC login for Web UIs ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-19 22:25:00 +02:00
Nicola Murino	21682d1c1d	add license header to source files ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-17 20:16:00 +02:00
Nicola Murino	55b47cf741	sftp realpath: resolve symlinks ... Fixes #890 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-17 16:02:45 +02:00
Nicola Murino	e0ce2e2e8a	allow to customize the log level ... The old log-verbose flag is not appropriate anymore. You should now use the log-level flag to set your preferred log level. The default level is "debug" as before, you can also set "info", "warn", "error" Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-13 10:40:24 +02:00
Nicola Murino	20e8cb898a	always check root dir in multi node setups ... Fixes #920 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-12 08:32:31 +02:00
Nicola Murino	1b8f94c08f	add event manager ... auto backup removed from setting. You can now schedule backups with the event manager Fixes #762 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-07-11 08:17:36 +02:00
Nicola Murino	e46051299f	s3: improve rename performance ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-30 18:22:58 +02:00
Nicola Murino	101783ee86	config: fix replace from env vars for some sub list ... ensure to merge configuration from files with configuration from env for all the sub lists Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-28 19:44:12 +02:00
Nicola Murino	9a6b1a1315	Fix issues found in PR #887 ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-25 10:42:17 +02:00
Nicola Murino	8762628481	backup: include folders set on group ... also fix sql tables prefix handling and add the sql prefix to CI Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-24 13:16:45 +02:00
Nicola Murino	a5e41c9336	S3: allow empty region ... the region may be embedded within the endpoint for some S3 compatible object storage Fixes #884 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-20 19:55:01 +02:00
Nicola Murino	729f30aebf	allow to refuse an upload from a sync upload hook ... Fixes #880 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-16 18:42:17 +02:00
Nicola Murino	1da213a6e3	CI: test resetprovider ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-15 20:08:31 +02:00
Nicola Murino	2b0b19da9e	add metrics for httpgs and sftpfs ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-14 19:37:25 +02:00
Nicola Murino	686166f2ce	remove deprecated APIs ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-14 18:30:57 +02:00
Nicola Murino	93ce593ed0	squash database migrations and remove the credentials_path setting ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-13 20:08:49 +02:00
Nicola Murino	6f4475ff72	httpfs: add support for UNIX domain sockets ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-12 18:29:49 +02:00
Nicola Murino	7ab30099dd	add httpfs ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-11 10:41:34 +02:00
Nicola Murino	9ae473fcdc	set version to 2.3.0 ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-04 05:01:48 +02:00
Nicola Murino	ecf715880f	update docs ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-03 14:36:38 +02:00
Nicola Murino	b2e28fe3a2	groups: apply placeholders to the fs config of virtual folders ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-06-02 09:45:01 +02:00
Nicola Murino	cc2f23bd89	trim values for string lists which can be set as env vars ... See #857 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-31 18:22:18 +02:00
Nicola Murino	7329cd804b	Fixes #855 ... update OpenAPI definition, add test cases, fix lint Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-30 19:01:12 +02:00
Nicola Murino	32da923dfe	httpd: add a setting to customize tokens validation ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-28 13:28:50 +02:00
Nicola Murino	7c724e18fe	add support for ACME compliant certificate authorities ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-27 07:39:55 +02:00
Nicola Murino	302f83c7a4	CI: fix for cockroach 22 ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-24 11:31:49 +02:00
Nicola Murino	984ca1fb7e	web UIs: update js and css deps ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-23 19:14:39 +02:00
Nicola Murino	1a33b5bb53	allow different TLS certificates for each binding ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-21 16:34:47 +02:00
Nicola Murino	751946f47a	allow to customize timeout and env vars for program based hooks ... Fixes #847 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-20 19:30:54 +02:00
Nicola Murino	796ea1dde9	allow to store temporary sessions within the data provider ... so we can persist password reset codes, OIDC auth sessions and tokens. These features will also work in multi-node setups without sicky sessions now Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-19 19:49:51 +02:00
Nicola Murino	67abf03fe3	web UIs: move common css to a separate template file ... so we can reuse it instead of copying the same CSS every time Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-14 11:54:55 +02:00
Nicola Murino	4995cf1b02	defender: allow to load blocklist/safelist also from config/env vars ... Fixes #831 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-13 14:46:07 +02:00
Nicola Murino	164621289c	awscontainer: add a flag to disable the installation code ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-07 12:50:49 +02:00
Nicola Murino	737109b2b8	sftpfs: add more ciphers, KEXs and MACs ... they are negotiated according to the order. Restrictions are generally configured server side. I want to avoid to expose other settings for now. Fixes #817 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-06 09:21:57 +02:00
Nicola Murino	80da2dc722	try to automatically find shared data dirs in system-wide paths ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-05 11:27:19 +02:00
Nicola Murino	61947e67ae	ftpd: add basic wildcard support ... this is the minimal implementation to allow mget and similar commands with wildcards. We only support wildcard for the last path level, for example: - mget *.xml is supported - mget dir/*.xml is supported - mget */*.xml is not supported Removed . and .. from FTP directory listing Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-04 19:32:02 +02:00
Nicola Murino	9a37e3d159	back to development ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-05-01 21:51:58 +02:00
Nicola Murino	14fb6c4038	always check recently updated users ... also fix the query to get users for quota check for sql based providers Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-30 11:59:36 +02:00
Nicola Murino	ecd488a840	data provider: remove prefer_database_credentials ... Google Cloud Storage credentials are now always stored within the data provider. Added a migration to read credentials from disk and store them inside the data provider. After v2.3 we can also remove credentials_path Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-28 12:55:01 +02:00
Nicola Murino	4a44a7dfe1	improved readlink handling ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-27 18:38:46 +02:00
Nicola Murino	97f8142b1e	azblobfs: update to the latest sdk and fix compatibility ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-25 17:34:52 +02:00
Nicola Murino	504cd3efda	add groups support ... Using groups simplifies the administration of multiple accounts by letting you assign settings once to a group, instead of multiple times to each individual user. Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-25 15:49:11 +02:00
Nicola Murino	002a06629e	refactoring of user session counters ... Fixes #792 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-14 19:07:41 +02:00
Nicola Murino	cacfffc5bf	OIDC: add support for custom fields ... These fields can be used in the pre-login hook to implement custom logics Fixes #787 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-12 19:31:25 +02:00
Nicola Murino	a3f50029ba	update moment.js to v2.29.2 ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-09 10:05:15 +02:00
Nicola Murino	f9d8b83c2a	sshd: disable by default ssh-rsa host key algo ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-04 18:52:19 +02:00
Nicola Murino	254b2ae87f	add support for AWS container ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-03 08:52:36 +02:00
Nicola Murino	77f3400161	allow to mount virtual folders on root (/) path ... Fixes #783 Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-04-02 18:32:46 +02:00
Nicola Murino	e079444e8a	update deps ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-31 09:54:59 +02:00
Nicola Murino	3cb23ac956	be sure to close an SSH connection if all channels are idle ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-30 10:59:25 +02:00
Nicola Murino	8fb256ac91	add link to an external Traefik tutorial ... update deps Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-29 18:13:43 +02:00
Nicola Murino	ca32cd5e0e	allow placeholders for add/update users and folders ... remove session token for S3, a temporary token is useless for our usage Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-27 16:32:21 +02:00
Nicola Murino	e0defafa26	azblob: fix the error returned in fs.Stat ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-26 11:47:12 +01:00
Nicola Murino	d955ddcef9	check that the jwt token is used by the same IP for which it ... Signed-off-by: Nicola Murino <nicola.murino@gmail.com>	2022-03-24 22:03:17 +01:00