A real-time digital accessibility assistant Chrome extension that automatically generates alt-text for images and transcribes audio/video content on web pages.
AutoAccess is designed to address SDG 10 (Reduced Inequalities) by making the web more accessible. It leverages Google Cloud Vision API for image analysis and Speech-to-Text for audio transcription to enhance web accessibility in real-time.
- Automatic Alt Text Generation: Scans web pages for images missing alt text and uses AI to generate descriptive, contextually relevant alternatives.
- Audio/Video Transcription: Automatically creates transcripts for audio and video content lacking captions.
- Minimal Performance Impact: Uses edge computing principles to minimize latency and reduce the impact on browsing performance.
- Privacy-Focused: Processes content locally when possible and only sends minimal data to secure cloud services.
- Simple User Interface: Easy-to-use controls to enable/disable features as needed.
- Frontend: Chrome Extension with content scripts that run on web pages
- Backend: Google Cloud Functions for serverless processing
- APIs Used:
- Google Cloud Vision API for image analysis
- Google Cloud Speech-to-Text for audio transcription
- Clone this repository or download the source code
- Open Chrome and navigate to
chrome://extensions/ - Enable "Developer mode" in the top-right corner
- Click "Load unpacked" and select the extension directory
- The AutoAccess icon should appear in your browser toolbar
Before using the extension, you need to set up Google Cloud Functions:
- Create a Google Cloud Platform account if you don't have one
- Create a new project and enable the Vision API and Speech-to-Text API
- Deploy the provided Cloud Functions code (
cloud-function.js) to Google Cloud Functions - Update the endpoint URLs in the extension's code (
content.jsandaudio-transcription.js) with your Cloud Function URLs
After installation, AutoAccess will automatically:
- Detect images missing alt text on any web page you visit
- Generate descriptive alt text for those images
- Find audio/video content without captions
- Create and add transcripts to that content
You can use the extension popup menu to:
- Enable/disable automatic alt text generation
- Enable/disable audio/video transcription
- Manually trigger a scan of the current page
- View statistics on accessibility improvements
autoAccess/
├── manifest.json # Extension configuration
├── content.js # Main content script for image alt text
├── audio-transcription.js # Module for audio/video transcription
├── popup.html # Extension popup UI
├── popup.js # Popup functionality
├── background.js # Background service worker
├── cloud-function.js # Google Cloud Function for image analysis
└── icons/ # Extension icons
- Make changes to the extension code
- Refresh the extension in
chrome://extensions/by clicking the refresh icon - Test on various websites that have accessibility issues
This project is licensed under the MIT License - see the LICENSE file for details.
Contributions are welcome! Please feel free to submit a Pull Request.
For any questions or feedback, please open an issue on this repository.
This project was developed to promote web accessibility and contribute to the United Nations Sustainable Development Goal 10: Reduced Inequalities.