Twitter open-sourced a part of its recommendation algorithm on March 31, 2023; we’re here for it. Read this article if you want to learn more about how to understand any codebase in seconds by using LangChain, LangChain’s Conversational Retriever Chain, Deep Lake, and GPT-4. As a bonus, you’ll also learn how the Twitter recommendation algorithm works and the top 10 tips for trending on Twitter in

We present basic math related to computation and memory usage for transformers Introduction# A lot of basic, important information about transformer language models can be computed quite simply. Unfortunately, the equations for this are not widely known in the NLP community. The purpose of this document is to collect these equations along with related knowledge about where they come from and why t

Learn how Replit trains Large Language Models (LLMs) using Databricks, Hugging Face, and MosaicML IntroductionLarge Language Models, like OpenAI's GPT-4 or Google's PaLM, have taken the world of artificial intelligence by storm. Yet most companies don't currently have the ability to train these models, and are completely reliant on only a handful of large tech firms as providers of the technology.

Introduction When I first started playing with Stable Diffusion text-to-image generation, in August 2022, my immediate reaction was, "ZOMG! I need to make art prints for my art wall!". Only to then immediately face-plant because vanilla Stable Diffusion is quite challenging to tame. If you are trying to reproduce a specific subject, you need to utilize additional strategies and techniques, none of

Large language models have taken the public attention by storm – no pun intended. In just half a decade large language models – transformers – have almost completely changed the field of natural language processing. Moreover, they have also begun to revolutionize fields such as computer vision and computational biology. Since transformers have such a big impact on everyone’s research agenda, I wan

Sat, 15 Apr 2023 I liked this simple calculus exercise A recent Math SE question asked for help computing the value of $$\int_0^{2000} e^{x/2-\left\lfloor x/2\right\rfloor}\; dx.\tag{$\star$}$$ (!!\left\lfloor \frac x2 \right\rfloor!! means !!\frac x2!! rounded down to the nearest integer.) Often when I see someone's homework problems I exclaim “what blockhead TA assigned this?” But I think this i

In-Browser Inference: WebLLM is a high-performance, in-browser language model inference engine that leverages WebGPU for hardware acceleration, enabling powerful LLM operations directly within web browsers without server-side processing. Full OpenAI API Compatibility: Seamlessly integrate your app with WebLLM using OpenAI API with functionalities such as streaming, JSON-mode, logit-level control,

[Hacker News discussion, LinkedIn discussion, Twitter thread] Update: My upcoming book, AI Engineering (late 2024/early 2025) will cover building aplications with foundation models in depth. A question that I’ve been asked a lot recently is how large language models (LLMs) will change machine learning workflows. After working with several companies who are working with LLM applications and persona

Elixir and Rust is a good mix Author Name Jason Stiebs @peregrine @peregrine Image by Annie Ruygt This post is about using Rust with Elixir and how easily it can be done! If you want to deploy your Phoenix LiveView app right now, then check out how to get started. You could be up and running in minutes. Problem We need to perform a CPU intensive or system level programming task and there are just

The ability to peek under the hood of the operating system can be a powerful tool for debugging. Spelunking Apple’s Open Source, a recent blog post by Daniel Jalkut’s, struck a very familiar chord with me, reminding me of times I spent poring through WebKit internals at my previous employer. I've been able to continue that pattern at Tailscale, now more focused on Darwin (the operating system at t

Auto-GPT Unmasked: The Hype and Hard Truths of Its Production Pitfalls Auto-GPT: A groundbreaking project or just another overhyped AI experiment? In this blog post, we unravel the truth behind the buzz and reveal the limitations that make this project unsuitable for real-world applications. The tech world has recently been abuzz with the astounding rise of Auto-GPT, an experimental open-source ap

January 3, 2023: CES Intel Extends Performance Leadership with World's Fastest Mobile Processor January 4, 2023: Intel to Report Fourth-Quarter and Full-Year 2022 Financial Results January 5, 2023: Meet an Intel Manufacturing Tech January 10, 2023: Intel Introduces 4th Gen Xeon Scalable, Max Series (Replay) January 10, 2023: Intel Launches 4th Gen Xeon Scalable Processors, Max Series CPUs January