Get subtitles for any audio/video being played in browser

Overview of My Submission

Browser extension that streams selected tab’s audio to Deepgram’s transcription service and displays result on active tab.

This extension will require a Deepgram API key for transcription. Get it from here


This content originally appeared on DEV Community and was authored by Gajanan Patil

Overview of My Submission

Browser extension that streams selected tab's audio to Deepgram's transcription service and displays result on active tab.

This extension will require a Deepgram API key for transcription. Get it from here

Submission Category:

Accessibility Advocates

Link to Code on GitHub

GitHub logo gajananpp / captioner

Get subtiles/captions for any audio/video being played.

Captioner

lint build

Get subtiles/captions for any audio/video being played. Deepgram hackathon submission.

InstallationUsageBuild From SourcePrivacyFAQs

Demo PNG

Installation

This extension is published on chrome web store.

Add from Chrome web store

Usage

This extension will require a Deepgram API key for transcription. Get it from here

Check demo video

Build from source:

git clone https://github.com/gajananpp/captioner.git

cd captioner

npm install

npm run build

This will output extension in dist folder which you can load in your browser by following this steps.

Privacy

The only external api call this extension makes is to wss://api.deepgram.com/v1/listen passing it the audio blobs from selected audio source as payload.

FAQs

Q: With which browsers is this extension compatible ?
This extension will work with chrome and other chromium based browsers like edge, brave etc. and can be tweaked to work with firefox and other browsers.


Q: From where can this extension be installed ?
This…

Additional Resources / Info

FAQs :-

Q: With which browsers is this extension compatible ?
This extension will work with chrome and other chromium based browsers like edge, brave etc. and can be tweaked to work with firefox and other browsers.

Q: From where can this extension be installed ?
This extension is published on chrome web store. Click below to view it in chrome web store or can be built and loaded from source.

Add from Chrome web store

Q: Subtitles are slower than audio/video ?
Since unlike Youtube's auto-generated captions where captions are generated when video is uploaded, here it can't seek audio blobs beforehand(could be possible by checking n/w requests having media type responses) so there is a lag. Lag may get reduced by adjusting the timeslice of AudioRecorder. WIP for reducing lag.


This content originally appeared on DEV Community and was authored by Gajanan Patil


Print Share Comment Cite Upload Translate Updates
APA

Gajanan Patil | Sciencx (2022-04-05T19:02:17+00:00) Get subtitles for any audio/video being played in browser. Retrieved from https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/

MLA
" » Get subtitles for any audio/video being played in browser." Gajanan Patil | Sciencx - Tuesday April 5, 2022, https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/
HARVARD
Gajanan Patil | Sciencx Tuesday April 5, 2022 » Get subtitles for any audio/video being played in browser., viewed ,<https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/>
VANCOUVER
Gajanan Patil | Sciencx - » Get subtitles for any audio/video being played in browser. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/
CHICAGO
" » Get subtitles for any audio/video being played in browser." Gajanan Patil | Sciencx - Accessed . https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/
IEEE
" » Get subtitles for any audio/video being played in browser." Gajanan Patil | Sciencx [Online]. Available: https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/. [Accessed: ]
rf:citation
» Get subtitles for any audio/video being played in browser | Gajanan Patil | Sciencx | https://www.scien.cx/2022/04/05/get-subtitles-for-any-audio-video-being-played-in-browser/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.