Emi Simpson
af4b3b06c0
SUPPLEMENTALLY: - Add an `expiration` field to the `file` table of the database - Produce a migration for the above change - Overhaul the cleanup script, and integrate into fhost.py (now run using FLASK_APP=fhost flask prune) - Replace the old cleanup script with a deprecation notice - Add information about how to expire files to the index - Update the README with information about the new script Squashed commits: Add a note explaining that expired files aren't immediately removed Show correct times on the index page graph Improve the migration script, removing the need for --legacy Use automap in place of an explicit file map in migration Remove vestigial `touch()` Don't crash when upgrading a fresh database Remove vestigial warning about legacy files More efficiently filter to unexpired files when migrating mia/0x0#72 (comment) Coalesce updates to the database during migration mia/0x0#72 (comment) Remove vestigial database model mia/0x0#72 (comment) prune: Stream expired files from the database (as opposed to collecting them all first) config.example.py: Add min & max expiration + description |
||
|---|---|---|
| instance | ||
| migrations | ||
| nsfw_model | ||
| templates | ||
| tests | ||
| .gitignore | ||
| .mailmap | ||
| cleanup.py | ||
| fhost.py | ||
| LICENSE | ||
| nsfw_detect.py | ||
| pyproject.toml | ||
| README.rst | ||
| requirements.txt | ||
The Null Pointer
This is a no-bullshit file hosting and URL shortening service that also runs 0x0.st. Use with uWSGI.
Configuration
To configure 0x0, copy instance/config.example.py to
instance/config.py, then edit it. Resonable defaults are
set, but there's a couple options you'll need to change before running
0x0 for the first time.
By default, the configuration is stored in the Flask instance directory. Normally, this is in ./instance, but it might be different for your system. For details, see the Flask documentation.
To customize the home and error pages, simply create a
templates directory in your instance directory and copy any
templates you want to modify there.
If you are running nginx, you should use the
X-Accel-Redirect header. To make it work, include this in
your nginx config’s server block:
location /up {
internal;
}where /up is whatever you’ve configured as
FHOST_STORAGE_PATH.
For all other servers, set FHOST_USE_X_ACCEL_REDIRECT to
False and USE_X_SENDFILE to True,
assuming your server supports this. Otherwise, Flask will serve the file
with chunked encoding, which has several downsides, one of them being
that range requests will not work. This is a problem for example when
streaming media files: It won’t be possible to seek, and some ISOBMFF
(MP4) files will not play at all.
To make files expire, simply create a cronjob that runs
FLASK_APP=fhost flask prune every now and then.
Before running the service for the first time, run
FLASK_APP=fhost flask db upgrade.
NSFW Detection
0x0 supports classification of NSFW content via Yahoo’s open_nsfw Caffe neural network model. This works for images and video files and requires the following:
- Caffe Python module (built for Python 3)
ffmpegthumbnailerexecutable in$PATH
Network Security Considerations
Keep in mind that 0x0 can fetch files from URLs. This includes your local network! You should take precautions so that this feature cannot be abused. 0x0 does not (yet) have a way to filter remote URLs, but on Linux, you can use firewall rules and/or namespaces. This is less error-prone anyway.
For instance, if you are using the excellent FireHOL, it’s very easy to create a group on your system and use it as a condition in your firewall rules. You would then run the application server under that group.