Couple ideas come to mind:

• Disable the file upload option by default and provide a setting to enable
• Provide an option to restrict file upload to specific groups and users