Multimodality

Have you checked out the cool Whisper-WebUI yet? 

1 Generate subtitles from: Files, Youtube, Mic

2 In subtitle formats: SRT, WebVTT, etc

3 Whisper’s end-to-end STT translation From other languages to English.

4 Text to Text: Translate subtitle files using Meta’s NLLB, DeepL API

Project link: https://t.co/wxfoT60nEn

License: Apache-2.0 license

— Gradio (@Gradio) January 26, 2024

https://github.com/jhj0517/Whisper-WebUI

AI Video Mapping Emotions to Human Expression

Teaching AI to have emotional intelligence.  Challenges for objectively measuring human emotions across various cultural contexts.

🆕 ep: @AlanCowen , CEO and Chief Scientist at @hume_ai, joins @labenz to discuss:

– teaching AI to have emotional intelligence

– challenges for objectively measuring human emotions across various cultural contexts

– optimizing AI to create greater human happiness pic.twitter.com/gg0hMiNMsG

— The Cognitive Revolution Podcast (@CogRev_Podcast) December 10, 2023

100% Local Tiny AI Vision Language Model (1.6B) – Very Impressive!!

Prompt Highlighter: Interactive Control for Multi-Modal LLMs

https://julianjuaner.github.io/projects/PromptHighlighter

OMG-Seg: Is One Model Good Enough For All Segmentation?https://lxtgh.github.io/project/omg_seg/

Be Sure To Read “This Week In AI”

This week’s executive overview and top links are here:

AI News #17: Week Ending 01/26/2024 with Executive Summary and Top 12 Stories

The post you just read is an extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

• Agents/Copilots
• Artificial General Intelligence (AGI)
• Augmented and Virtual Reality (AR/VR)
• Autonomous Vehicles
• AI Audio
• Business and Enterprise AI
• Chips and Hardware
• Consumer Products
• Education
• Ethics/Legal Security
• Images/Photos
• Locally Run AI Models
• Meta
• OpenAI
• Open Source
• Podcasts/YouTube
• Publishing and News
• Robots and Embodiment
• Science and Medicine
• Video
• Vision/Multimodality
• X/Twitter/Grok
• Tech and Development

Credits/Sources

Most of these links come from just a few incredible sources.  Please follow them:

• Robert Scoble: https://x.com/Scobleizer
• Ethan Mollick:  https://www.linkedin.com/in/emollick/
• David Armano: https://www.linkedin.com/in/darmano/
• Alan Thompson: https://lifearchitect.ai/
• Theoretically Media: https://www.youtube.com/@TheoreticallyMedia 
• The Rundown: https://www.therundown.ai/
• Borriss: https://twitter.com/_Borriss_  
• Bilawal Sidhu:  https://twitter.com/bilawalsidhu/ 
• TLDR: https://tldr.tech/ai 
• Jeremiah Owyang: https://twitter.com/jowyang 
• Wes Roth: https://www.youtube.com/@WesRoth 

Previous Issues

• AI News: Week Ending 01/19/2024: https://ethanbholland.com/2024/02/04/ai-news-16-week-ending-01-19-2024-with-executive-summary-and-top-16-stories/ 
• AI News: Week Ending 01/12/2024: https://ethanbholland.com/2024/01/15/ai-news-15-week-ending-01-012-2024-with-executive-summary-and-top-13-stories/ 
• AI News: Week Ending 01/05/2024: https://ethanbholland.com/2024/01/14/ai-news-14-week-ending-01-05-2023-with-executive-summary-and-top-16-stories/  
• AI News: Week Ending 12/29/2023: https://ethanbholland.com/2024/01/07/ai-news-12-week-ending-12-29-2023-with-executive-summary-and-top-9-stories/ 
• AI News: Week Ending 12/22/2023: https://www.linkedin.com/pulse/ai-news-week-ending-12222023-executive-summary-top-links-holland-frx4e 
• AI News: Week Ending 12/15/2023: https://www.linkedin.com/pulse/ai-news-week-ending-12152023-ethan-holland-elmee 
• AI News: Week Ending 12/08/2023: https://www.linkedin.com/pulse/ai-news-week-ending-12082023-ethan-holland-zabve 
• AI News: Week Ending 12/01/2023: https://www.linkedin.com/pulse/ai-news-week-ending-12012023-ethan-holland-rglve  
• AI News: Week Ending 11/24/2023: https://www.linkedin.com/pulse/ai-news-week-ending-11242023-ethan-holland-jqvre 
• AI News: Week Ending 11/17/2023: https://www.linkedin.com/pulse/ai-news-week-ending-11172023-ethan-holland-ad6le  
• AI News: Week Ending 11/10/2023: https://www.linkedin.com/pulse/ai-news-week-ending-11102023-executive-summary-top-three-holland-yjdef/ 
• AI News: Week Ending 11/03/2023: https://www.linkedin.com/posts/ethanholland_aiebh-ai-generativeai-activity-7131396231678844928-3U8M
• AI News: Week Ending 10/27/2023: https://www.linkedin.com/posts/ethanholland_aiebh-ai-generativeai-activity-7127139342321356800-uBPD
• AI News: Week Ending 10/20/2023: https://www.linkedin.com/pulse/ai-news-week-ending-10202023-ethan-holland-eocpe 
• AI News: Week Ending 10/13/2023:  https://www.linkedin.com/pulse/ai-news-week-ending-10132023-executive-summary-ethan-holland-nq9bf 
• AI News: Week Ending 10/6/2023: https://www.linkedin.com/pulse/ai-news-week-ending-1062023-ethan-holland-b6uhe