I have a client side software which directly streams audio from a fileserver with public multimedia files exposed.
I'm using AWS S3 like web services, and I'm trying to maintain file hosting costs the lowest (Currently 0$). So any paid solution for data storage has been already reviewed.
The file collection size is really increasing. It might be close to 10TB of files during the next 12 months. For now I manage around 250Gb of diverse quality mp3 files and images.
I would like to implement a server for streaming multimedia files, and I would like some advice in which server architecture/technology to use for this purpose (Hadoop, Nginx, ..)
First requisites might be:
- good I/O management
- handling many persistent and durable connections for streaming.
The file security is not an issue in this question
Any help is welcome.