AI

Exploring Medusa and Multi-Token Prediction

10 min read

Exploring Medusa and Multi-Token Prediction

CAT July 10, 2024

Matthew Gunton This blog post will go into detail on the “MEDUSA: Simple LLM Inference Acceleration Framework...

How to Test Machine Learning Systems

CAT July 10, 2024

Eyal Trabelsi From concepts to practical code snippets for effective testing Image by the author Testing in software...

Heat Diffusion in a Thin Metal Rod

CAT July 10, 2024

Sébastien Gilbert The solution to the heat diffusion equation meets the Fourier series What would happen if you...

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.

Necessary

Always Enabled

Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.

Cookie	Duration	Description
cookielawinfo-checkbox-analytics	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional	11 months	The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance	11 months	This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy	11 months	The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Functional

Performance

Analytics

Others

AI

Exploring Medusa and Multi-Token Prediction

How to Test Machine Learning Systems

Heat Diffusion in a Thin Metal Rod

Building a Standout Data Science Portfolio: A Comprehensive Guide

Language Models and Spatial Reasoning: What’s Good, What Is Still Terrible, and What Is Improving

Delta Lake Optimistic Concurrency Control: To Lock or Not to Lock?

Achieve up to ~2x higher throughput while reducing costs by up to ~50% for generative AI inference on Amazon SageMaker with the new inference optimization toolkit – Part 2

Achieve up to ~2x higher throughput while reducing costs by ~50% for generative AI inference on Amazon SageMaker with the new inference optimization toolkit – Part 1

Anthropic Claude 3.5 Sonnet ranks number 1 for business and finance in S&P AI Benchmarks by Kensho

AI-Proof Your Data Science Skill Set by Embracing Four Timeless Concepts

You may have missed

Bug stops M4 Macs from virtualizing older macOS versions

Foxconn India drops recruitment discrimination against married women

How to create a podcast with AI in seconds: Easy, step-by-step instructions

The best password manager for Mac in 2024: Expert tested