Ethan B. Holland

Over 56,600 manually organized AI links and counting

Photorealistic image. a modern, brightly lit lab environment with multiple high-resolution computer monitors displaying lines of code and AI neural network visualizations. On one of the screens, a complex diagram illustrates the architecture of a large language model. Around the lab, there are open notebooks filled with notes and equations, hinting at the collaborative and intensive nature of AI research. A team of diverse researchers works together, discussing strategies and adjustments to improve the model's performance. The environment is clean, organized, and filled with innovative technology, symbolizing the cutting-edge work being done in the field of AI. Warm colors should be used to give the scene a welcoming and energetic feel. --ar 16:9

AI Tech and Development News: Week Ending 03/08/2024

PROMPT: Photorealistic image. a modern, brightly lit lab environment with multiple high-resolution computer monitors displaying lines of code and AI neural network visualizations. On one of the screens, a complex diagram illustrates the architecture of a large language model. Around the lab, there are open notebooks filled with notes and equations, hinting at the collaborative and intensive nature of AI research. A team of diverse researchers works together, discussing strategies and adjustments to improve the model’s performance. The environment is clean, organized, and filled with innovative technology, symbolizing the cutting-edge work being done in the field of AI. Warm colors should be used to give the scene a welcoming and energetic feel. –ar 16:9

“Useful Resources for AI Research, Inference & Agents (Discord + Podcastast + Youtube + X) Discord Channels ======================================= Research + Community (Including AI ToolChains)–> Note: Some of these discord servers have started gatekeeping due to massive…” / X – https://twitter.com/thefirehacker/status/1766020371839422639

Paper page – Design2Code: How Far Are We From Automating Front-End Engineering? – https://huggingface.co/papers/2403.03163

“Check-out this repo, if you want to learn more about LLMs or transformers I’ve been working on this for past 3months and now it’s finally done. It has everything you need to make a model of your own and train it like I did Try it & let me know your views https://t.co/ahsraOlG57” / X – https://twitter.com/shivendrra_/status/1766021155192787182

“Nice read on the rarely-discussed-in-the-open difficulties of training LLMs. Mature companies have dedicated teams maintaining the clusters. At scale, clusters leave the realm of engineering and become a lot more biological, hence e.g. teams dedicated to “hardware health”. It…” / X – https://twitter.com/karpathy/status/1765424847705047247 

Optimizing Technical Docs for LLMs | kapa.ai docs – https://docs.kapa.ai/blog/optimizing-technical-documentation-for-llms

LLM Time Capsule by OctoAI – https://llmtimecapsule.octo.ai/ 

Training great LLMs entirely from ground up in the wilderness as a startup — Yi Tay – https://www.yitay.net/blog/training-great-llms-entirely-from-ground-zero-in-the-wilderness 

Aggregator’s AI Risk – Stratechery by Ben Thompson – https://stratechery.com/2024/aggregators-ai-risk/

Major TOM Viewer – a Hugging Face Space by Major-TOM – https://huggingface.co/spaces/Major-TOM/MajorTOM-Core-Viewer

[2311.12022v1] GPQA: A Graduate-Level Google-Proof Q&A Benchmark – https://arxiv.org/abs/2311.12022v1 

Is Synthetic Data the Key to AGI? – by Nabeel S. Qureshi – https://digitalspirits.substack.com/p/is-synthetic-data-the-key-to-agi  

[2403.00071] Resonance RoPE: Improving Context Length Generalization of Large Language Models – https://arxiv.org/abs/2403.00071 

[2403.02308v1] Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures – https://arxiv.org/abs/2403.02308v1  

[2402.14992] tinyBenchmarks: evaluating LLMs with fewer examples – https://arxiv.org/abs/2402.14992 

“Today we are announcing the release of a new model, Genstruct 7B. Genstruct 7B is an instruction-generation model, designed to create valid instructions given a raw text corpus. This enables the creation of new, partially synthetic instruction finetuning datasets from any… https://t.co/KUZ0eI8zRc” / X – https://twitter.com/NousResearch/status/1765806725880590683 
Paper page – GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection – https://huggingface.co/papers/2403.03507

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #23: Week Ending 03/08/2024 with Executive Summary and Top 38 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

Previous Issues

Heads up! You’ve scrolled to the end of this category. There may have been just one or two links (above), so go back up and double check to be sure you didn’t quickly scroll down past it.

Be Sure To Read This Week’s Main Post:

This week’s executive overview and top links are here:

AI News #23: Week Ending 03/08/2024 with Executive Summary and Top 38 Links

The post you just read is an deep dive extension of my weekly newsletter, This Week In AI, an executive summary of the top things to know in AI. Each week, I create an accessible overview for laypeople to feel confident they are conversant with the week’s AI developments. I include a curated list of must-click links of the week, to offer everyone a hands-on opportunity to explore the most intriguing updates in artificial intelligence across various categories, including robotics, imagery, video, AR/VR, science, ethics, and more. Beyond the overview, I post these topic-based deeper dives (below). If you haven’t read this week’s overview, I recommend starting there.

Credits/Sources

Most of these weekly links come from just a few prolific oversharing sources. Please follow them, as they work hard to find the news each week and they make it a lot easier for me to compile.

Previous Issues

Leave a Reply

Trending

Discover more from Ethan B. Holland

Subscribe now to keep reading and get access to the full archive.

Continue reading