beenull/sftpgo
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1338 commits 8 branches 48 tags 35 MiB
Commit graph

394 commits

Author SHA1 Message Date
Nicola Murino
3e8254e398
fs actions: add first upload/download 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-21 19:01:08 +02:00
Nicola Murino
9ddd2d3588
eventmanager: add path exists filesystem action 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-20 14:13:43 +02:00
Nicola Murino
57935f585c
eventmanager: allow to execute fs actions based on schedules 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-19 15:04:00 +02:00
Nicola Murino
2b463d61e3
use epoch timestamp instead of current timestamp for unknown modification times 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-16 17:59:13 +02:00
Nicola Murino
ced4206c5f
allow cross folder renaming if the underlying resource is the same 
this was only allowed for the local filesystem before this change

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-15 21:39:04 +02:00
Nicola Murino
c86db09cd8
event manager: add Certificate renewal trigger 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-12 17:37:29 +02:00
Nicola Murino
194c3c13ac
event manager: add IP blocked trigger 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-11 20:09:53 +02:00
Nicola Murino
526f6e0f6b
cloud storage providers: remove head bucket requests 
let's just assume the bucket exists on "stat" requests for the "/" path

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-11 08:31:51 +02:00
Nicola Murino
a61211d32c
OIDC: allow to get the role field from a sub-struct 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-10 21:42:58 +02:00
Nicola Murino
4cd340e07f
eventmanager: add support for filesystem actions 
Fixes #931

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-10 18:41:59 +02:00
Nicola Murino
890dde0e00
back to development 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-05 18:48:58 +02:00
Nicola Murino
b1efe8d0b5
eventmanager: add support for data retention checks 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-04 21:50:38 +02:00
Nicola Murino
fdc10aa6c7
CORS: add support for more parameters 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-02 18:44:34 +02:00
Nicola Murino
455bb550ee
azblob: fix SAS URL with embedded container name 
Fixes #944

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-01 21:32:40 +02:00
Nicola Murino
9d2b5dc07d
refactor: move eventmanager to common package 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-08-01 18:48:54 +02:00
Nicola Murino
3ca62d76d7
back to development 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-30 10:07:09 +02:00
Nicola Murino
ef0a3bc571
add support for anonymous users 
Fixes #935

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-27 18:54:25 +02:00
Nicola Murino
ec5da8b4a5
ftpd: allow to require TLS on a per-user basis 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-26 18:51:39 +02:00
Nicola Murino
a2e73228d2
initprovider: don't execute actions 
we are not running as service here

Fixes #932

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-23 19:38:15 +02:00
Nicola Murino
1470018054
web UI: allow to enable OIDC login and/or login forms 
any combination is now supported

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-22 20:55:33 +02:00
Nicola Murino
e6bfbcd489
OIDC: allow to debug the received id_token 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-22 11:11:35 +02:00
Nicola Murino
a0bbcf6ebb
web client: add HTML5 player 
See #914

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-21 18:42:22 +02:00
Nicola Murino
d5946da1e2
OIDC: allow to enable only OIDC login for Web UIs 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-19 22:25:00 +02:00
Nicola Murino
21682d1c1d
add license header to source files 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-17 20:16:00 +02:00
Nicola Murino
55b47cf741
sftp realpath: resolve symlinks 
Fixes #890

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-17 16:02:45 +02:00
Nicola Murino
e0ce2e2e8a
allow to customize the log level 
The old log-verbose flag is not appropriate anymore.
You should now use the log-level flag to set your preferred log level.
The default level is "debug" as before, you can also set "info", "warn",
"error"

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-13 10:40:24 +02:00
Nicola Murino
20e8cb898a
always check root dir in multi node setups 
Fixes #920

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-12 08:32:31 +02:00
Nicola Murino
1b8f94c08f
add event manager 
auto backup removed from setting. You can now schedule backups with
the event manager

Fixes #762

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-07-11 08:17:36 +02:00
Nicola Murino
e46051299f
s3: improve rename performance 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-30 18:22:58 +02:00
Nicola Murino
101783ee86
config: fix replace from env vars for some sub list 
ensure to merge configuration from files with configuration from env for
all the sub lists

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-28 19:44:12 +02:00
Nicola Murino
9a6b1a1315
Fix issues found in PR #887 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-25 10:42:17 +02:00
Nicola Murino
8762628481
backup: include folders set on group 
also fix sql tables prefix handling and add the sql prefix to CI

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-24 13:16:45 +02:00
Nicola Murino
a5e41c9336
S3: allow empty region 
the region may be embedded within the endpoint for some S3 compatible
object storage

Fixes #884

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-20 19:55:01 +02:00
Nicola Murino
729f30aebf
allow to refuse an upload from a sync upload hook 
Fixes #880

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-16 18:42:17 +02:00
Nicola Murino
1da213a6e3
CI: test resetprovider 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-15 20:08:31 +02:00
Nicola Murino
2b0b19da9e
add metrics for httpgs and sftpfs 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-14 19:37:25 +02:00
Nicola Murino
686166f2ce
remove deprecated APIs 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-14 18:30:57 +02:00
Nicola Murino
93ce593ed0
squash database migrations and remove the credentials_path setting 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-13 20:08:49 +02:00
Nicola Murino
6f4475ff72
httpfs: add support for UNIX domain sockets 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-12 18:29:49 +02:00
Nicola Murino
7ab30099dd
add httpfs 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-11 10:41:34 +02:00
Nicola Murino
9ae473fcdc
set version to 2.3.0 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-04 05:01:48 +02:00
Nicola Murino
ecf715880f
update docs 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-03 14:36:38 +02:00
Nicola Murino
b2e28fe3a2
groups: apply placeholders to the fs config of virtual folders 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-06-02 09:45:01 +02:00
Nicola Murino
cc2f23bd89
trim values for string lists which can be set as env vars 
See #857

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-31 18:22:18 +02:00
Nicola Murino
7329cd804b
Fixes #855 
update OpenAPI definition, add test cases, fix lint

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-30 19:01:12 +02:00
Nicola Murino
32da923dfe
httpd: add a setting to customize tokens validation 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-28 13:28:50 +02:00
Nicola Murino
7c724e18fe
add support for ACME compliant certificate authorities 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-27 07:39:55 +02:00
Nicola Murino
302f83c7a4
CI: fix for cockroach 22 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-24 11:31:49 +02:00
Nicola Murino
984ca1fb7e
web UIs: update js and css deps 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-23 19:14:39 +02:00
Nicola Murino
1a33b5bb53
allow different TLS certificates for each binding 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-21 16:34:47 +02:00
Nicola Murino
751946f47a
allow to customize timeout and env vars for program based hooks 
Fixes #847

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-20 19:30:54 +02:00
Nicola Murino
796ea1dde9
allow to store temporary sessions within the data provider 
so we can persist password reset codes, OIDC auth sessions and tokens.
These features will also work in multi-node setups without sicky
sessions now

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-19 19:49:51 +02:00
Nicola Murino
67abf03fe3
web UIs: move common css to a separate template file 
so we can reuse it instead of copying the same CSS every time

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-14 11:54:55 +02:00
Nicola Murino
4995cf1b02
defender: allow to load blocklist/safelist also from config/env vars 
Fixes #831

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-13 14:46:07 +02:00
Nicola Murino
164621289c
awscontainer: add a flag to disable the installation code 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-07 12:50:49 +02:00
Nicola Murino
737109b2b8
sftpfs: add more ciphers, KEXs and MACs 
they are negotiated according to the order.
Restrictions are generally configured server side.
I want to avoid to expose other settings for now.

Fixes #817

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-06 09:21:57 +02:00
Nicola Murino
80da2dc722
try to automatically find shared data dirs in system-wide paths 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-05 11:27:19 +02:00
Nicola Murino
61947e67ae
ftpd: add basic wildcard support 
this is the minimal implementation to allow mget and similar commands with
wildcards.

We only support wildcard for the last path level, for example:

- mget *.xml is supported
- mget dir/*.xml is supported
- mget */*.xml is not supported

Removed . and .. from FTP directory listing

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-04 19:32:02 +02:00
Nicola Murino
9a37e3d159
back to development 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-05-01 21:51:58 +02:00
Nicola Murino
14fb6c4038
always check recently updated users 
also fix the query to get users for quota check for sql based providers

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-30 11:59:36 +02:00
Nicola Murino
ecd488a840
data provider: remove prefer_database_credentials 
Google Cloud Storage credentials are now always stored within the data
provider.

Added a migration to read credentials from disk and store them inside the
data provider.

After v2.3 we can also remove credentials_path

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-28 12:55:01 +02:00
Nicola Murino
4a44a7dfe1
improved readlink handling 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-27 18:38:46 +02:00
Nicola Murino
97f8142b1e
azblobfs: update to the latest sdk and fix compatibility 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-25 17:34:52 +02:00
Nicola Murino
504cd3efda
add groups support 
Using groups simplifies the administration of multiple accounts by
letting you assign settings once to a group, instead of multiple
times to each individual user.

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-25 15:49:11 +02:00
Nicola Murino
002a06629e
refactoring of user session counters 
Fixes #792

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-14 19:07:41 +02:00
Nicola Murino
cacfffc5bf
OIDC: add support for custom fields 
These fields can be used in the pre-login hook to implement custom
logics

Fixes #787

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-12 19:31:25 +02:00
Nicola Murino
a3f50029ba
update moment.js to v2.29.2 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-09 10:05:15 +02:00
Nicola Murino
f9d8b83c2a
sshd: disable by default ssh-rsa host key algo 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-04 18:52:19 +02:00
Nicola Murino
254b2ae87f
add support for AWS container 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-03 08:52:36 +02:00
Nicola Murino
77f3400161
allow to mount virtual folders on root (/) path 
Fixes #783

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-04-02 18:32:46 +02:00
Nicola Murino
e079444e8a
update deps 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-31 09:54:59 +02:00
Nicola Murino
3cb23ac956
be sure to close an SSH connection if all channels are idle 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-30 10:59:25 +02:00
Nicola Murino
8fb256ac91
add link to an external Traefik tutorial 
update deps

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-29 18:13:43 +02:00
Nicola Murino
ca32cd5e0e
allow placeholders for add/update users and folders 
remove session token for S3, a temporary token is useless for our usage

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-27 16:32:21 +02:00
Nicola Murino
e0defafa26
azblob: fix the error returned in fs.Stat 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-26 11:47:12 +01:00
Nicola Murino
d955ddcef9
check that the jwt token is used by the same IP for which it 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-24 22:03:17 +01:00
Nicola Murino
4bbb195711
plugin: reload IP filter plugin on demand 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-24 10:21:13 +01:00
Nicola Murino
9bfdc10172
add support for ipfilter plugins 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-23 10:58:01 +01:00
Nicola Murino
b062b38ef4
docker: add rsync to "full" images 
there are better alternatives and rsync will only work on local
filesystem, but it can still be useful to some people

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-22 17:29:14 +01:00
Nicola Murino
a31a9dc32c
update deps 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-21 17:52:18 +01:00
Nicola Murino
93b9c1617e
web UI: allow to load custom css 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-19 21:44:27 +01:00
Nicola Murino
4c710d731f
update to Go 1.18 
temporarily disabled docker image for ppcle64 as alpine image
is not yet available

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-18 21:52:00 +01:00
Nicola Murino
03da7f696c
SFTPGo is now listed on Azure Marketplace 
Fixes #684

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-17 14:59:02 +01:00
Nicola Murino
883a3dceaf
db defender: fix getHost query and add more test cases 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-16 18:22:08 +01:00
Nicola Murino
8502d7b051
improve transfer quota limits test case 
ReadAll can read more bytes than the effective size, for this test
io.Copy is better

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-15 22:13:07 +01:00
Nicola Murino
6f8b71b89f
s3fs: migrate to AWS SDK V2 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-15 19:16:50 +01:00
Nicola Murino
5582f5c811
data provider: add automatic backups 
Automatic backup are enabled by default, a new backup will be saved
each day at midnight.

The backups_path setting was moved from the httpd section to the
data_provider one, please adjust your configuration file and or your
env vars

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-13 13:45:07 +01:00
Nicola Murino
48ed3dab1f
update docs and deps 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-11 17:11:49 +01:00
Nicola Murino
d8de0faef5
allow to require two-factor auth for users 
Fixes #721

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-06 16:57:13 +01:00
Nicola Murino
df828b6021
gcsfs: use pagers when listing bucket objects 
Hopefully fixes #746

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-04 18:46:17 +01:00
Nicola Murino
056daaddfc
always execute fs checks for users not logged in after an update 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-03 19:31:54 +01:00
Nicola Murino
5c2fd8d52a
add support for a start directory 
Fixes #705

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-03-03 12:44:56 +01:00
Nicola Murino
4519bffa39
S3: add support for assume role 
Fixes #736

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-28 20:19:13 +01:00
Nicola Murino
1ea7429921
initprovider: add load data options 
Fixes #741

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-28 17:05:18 +01:00
dependabot[bot]
816c174036 Bump github.com/mattn/go-sqlite3 from 1.14.11 to 1.14.12 
Bumps [github.com/mattn/go-sqlite3](https://github.com/mattn/go-sqlite3) from 1.14.11 to 1.14.12.
- [Release notes](https://github.com/mattn/go-sqlite3/releases)
- [Commits](https://github.com/mattn/go-sqlite3/compare/v1.14.11...v1.14.12)

---
updated-dependencies:
- dependency-name: github.com/mattn/go-sqlite3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-28 09:26:17 +01:00
Nicola Murino
b64d3c2fbf
simplify rename permission 
before this patch we allow a rename in the following cases:

- the user has rename permission on both source and target path
- the user has delete permission on source path and create/upload on
  target path

we now check only the rename/rename_files/rename_dirs permissions.
This is what SFTPGo users expect.

This is a backward incompatible change and it will not backported to
the 2.2.x branch

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-26 12:19:09 +01:00
Nicola Murino
e18ad55067
S3: add support for session tokens 
Fixes #736

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-25 15:30:04 +01:00
Nicola Murino
4e9dae6fa4
allow to cache external authentications 
Fixes #733

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-25 11:51:10 +01:00
Nicola Murino
f5a0559be6
don't execute fs check if the user has recent activity 
The check could be expensive with some backends and is generally
only required the first time that a user logs in

Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-24 16:11:35 +01:00
Nicola Murino
8bbf54d2b6
azure blobs: add support for multipart downloads 
Signed-off-by: Nicola Murino <nicola.murino@gmail.com>
 2022-02-21 19:01:31 +01:00