Skip to content

Repository files navigation

AutoAccess

A real-time digital accessibility assistant Chrome extension that automatically generates alt-text for images and transcribes audio/video content on web pages.

Overview

AutoAccess is designed to address SDG 10 (Reduced Inequalities) by making the web more accessible. It leverages Google Cloud Vision API for image analysis and Speech-to-Text for audio transcription to enhance web accessibility in real-time.

Features

  • Automatic Alt Text Generation: Scans web pages for images missing alt text and uses AI to generate descriptive, contextually relevant alternatives.
  • Audio/Video Transcription: Automatically creates transcripts for audio and video content lacking captions.
  • Minimal Performance Impact: Uses edge computing principles to minimize latency and reduce the impact on browsing performance.
  • Privacy-Focused: Processes content locally when possible and only sends minimal data to secure cloud services.
  • Simple User Interface: Easy-to-use controls to enable/disable features as needed.

Technical Architecture

  • Frontend: Chrome Extension with content scripts that run on web pages
  • Backend: Google Cloud Functions for serverless processing
  • APIs Used:
    • Google Cloud Vision API for image analysis
    • Google Cloud Speech-to-Text for audio transcription

Installation

  1. Clone this repository or download the source code
  2. Open Chrome and navigate to chrome://extensions/
  3. Enable "Developer mode" in the top-right corner
  4. Click "Load unpacked" and select the extension directory
  5. The AutoAccess icon should appear in your browser toolbar

Configuration

Before using the extension, you need to set up Google Cloud Functions:

  1. Create a Google Cloud Platform account if you don't have one
  2. Create a new project and enable the Vision API and Speech-to-Text API
  3. Deploy the provided Cloud Functions code (cloud-function.js) to Google Cloud Functions
  4. Update the endpoint URLs in the extension's code (content.js and audio-transcription.js) with your Cloud Function URLs

Usage

After installation, AutoAccess will automatically:

  1. Detect images missing alt text on any web page you visit
  2. Generate descriptive alt text for those images
  3. Find audio/video content without captions
  4. Create and add transcripts to that content

You can use the extension popup menu to:

  • Enable/disable automatic alt text generation
  • Enable/disable audio/video transcription
  • Manually trigger a scan of the current page
  • View statistics on accessibility improvements

Development

Project Structure

autoAccess/
├── manifest.json         # Extension configuration
├── content.js            # Main content script for image alt text
├── audio-transcription.js # Module for audio/video transcription
├── popup.html            # Extension popup UI
├── popup.js              # Popup functionality
├── background.js         # Background service worker
├── cloud-function.js     # Google Cloud Function for image analysis
└── icons/                # Extension icons

Local Development

  1. Make changes to the extension code
  2. Refresh the extension in chrome://extensions/ by clicking the refresh icon
  3. Test on various websites that have accessibility issues

License

This project is licensed under the MIT License - see the LICENSE file for details.

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Contact

For any questions or feedback, please open an issue on this repository.

Acknowledgements

This project was developed to promote web accessibility and contribute to the United Nations Sustainable Development Goal 10: Reduced Inequalities.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages