If it is SDL Tridion 2011, in your scenario (huge number of digital assets), I would recommend using a separate Digital Asset Management (DAM) system instead of storing them in SDL Tridion. To be noted, SDL Tridion is a Web Content Management system with few capabilities of a DAM system. and then accessing these assets using external URL. Primarily streaming through a typical good DAM system is much more efficient, fast and smooth as compared to accessing it over a File System/DB. For example: You may have your Videos on a DAM called OOYALA and you are referencing it through an external URL, in all aspect the experience would be much better as compared to if you have stored the video in SDL Tridion and accessing it from File System after publishing.
If it is SDL Tridion 2013, in your scenario, I would highly recommend using a separate DAM system and referencing them using external URLs (or may be you may choose to write a Provider for ECL). This way it also provide you to manage the content from Tridion
In both cases, you always have a flexibility to scale out your solution, and if these digital assets are to be used by any other solution like a CRM tool or any other marketing tool, you need not to worry about their integration with SDL Tridion
Please note, generally the Digital Assets are common to many solutions and you should respect the scalability here.