Latest Posts

Key Components of Observability In infrastructure and systems, logs, metrics, and tracing are all key to achieving observability. These components are also critical to achieving ML observability , which is the practice of obtaining a deep understanding into your model’s data and performance across its lifecycle. Inference Store – Records of ML prediction events that…

As more and more teams turn to machine learning to streamline their businesses or turn previously impractical technologies into reality, there has been a rising interest in ML infrastructure tools to help teams get from research to production and troubleshoot model performance. Google built TFX, Facebook built FBLearner, Uber built Michaelangelo, Airbnb built Bighead, and…

Long-Context Powerhouse: Training-Free Approach Extends LLM Capabilities [Paper] Large language models (LLMs) are revolutionizing various fields, but their effectiveness often hinges on their ability to understand long stretches of text. This is crucial for tasks like analyzing lengthy documents, remembering extended dialogue history, and powering chatbots. While recent advancements have shown success in improving LLMs’…

The world of artificial intelligence is continually evolving, with Large Language Models (LLMs) at the forefront, showcasing extraordinary capabilities across a myriad of natural language processing tasks. Yet, as these models grow in size, their deployment becomes increasingly challenging. Concerns about their environmental and economic impacts due to high energy consumption have pushed the field…

EMO: Emote Portrait Alive – Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions [Ref] [Ref] The landscape of image generation has undergone a seismic shift thanks to the advent of Diffusion Models, a breakthrough that’s redefining the boundaries of digital creativity. These models, distinguished for their prowess in crafting high-fidelity images, are…

Constructing ChatGPT The established approach currently is as follows: Source: Chip Huyen Initially, you gather trillions of words from billions of documents, and through a self-supervised process, you prompt the model to forecast the subsequent token (word or sub-word) in a given sequence. Subsequently, you aim to instruct the model to act in a specific…

In a remarkably short period of under two months since its initial launch, the ML research group at Apple has made impressive progress with their latest innovation, MLX, as evidenced by its rapid acceptance within the ML community. This is highlighted by its acquisition of more than 12,000 stars on GitHub and the formation of…

If you perceive your Apple MacBook solely as a device for creating PowerPoint presentations, surfing the internet, and watching series, then you truly misunderstand its capabilities. Indeed, the MacBook transcends mere aesthetics; its prowess in artificial intelligence is equally astounding. Within the MacBook lies an impressively capable GPU, designed specifically to excel in the execution…