Month: February 2024

On Thursday, Google unveiled Gemini 1.5 Pro, which the company describes as delivering “dramatically enhanced performance” over the previous model. The company’s AI trajectory — viewed internally as increasingly critical for its future — follows the unveiling of Gemini 1.0 Ultra last week, alongside the rebranding of the Bard chatbot (to Gemini) to align with the new model’s more powerful and versatile capabilities.

In an announcement blog post, Google CEO Sundar Pichai and Google DeepMind CEO Demis Hassabis try to balance assuring their audience about ethical AI safety while touting their models’ rapidly advancing capabilities. “Our teams continue pushing the frontiers of our latest models with safety at the core,” Pichai summarized.

The company needs to emphasize safety for AI skeptics (including one former Google CEO) and government regulators. But it also needs to stress its models’ accelerating performance for AI developers, potential customers and investors concerned the company was too slow to react to OpenAI’s breakout success with ChatGPT.

Pichai and Hassabis say Gemini 1.5 Pro delivers comparable results to Gemini 1.0 Ultra. However, Gemini 1.5 performs at that level more efficiently, with reduced computational requirements. The multimodal capabilities include processing text, images, videos, audio or code. As AI models advance, they’ll continue to offer a more versatile array of capabilities in one prompt box (another recent example was OpenAI integrating DALL-E 3 image generation into ChatGPT).

ALAIN JOCARD via Getty Images

Gemini 1.5 Pro can also handle up to one million tokens, or the units of data AI models can process in a single request. Google says Gemini 1.5 Pro can process over 700,000 words, an hour of video, 11 hours of audio and codebases with over 30,000 lines of code. The company says it’s even “successfully tested” a version that supports up to 10 million tokens.

The company says Gemini 1.5 Pro maintains high accuracy in queries with larger token counts when it has more new data to learn. It says the model impressed in the Needle In a Haystack evaluation. In this test, developers insert a small piece of information inside a long text block to see if the AI model can pick it out. Google said Gemini 1.5 Pro could find the embedded text 99 percent of the time in data blocks as long as one million tokens.

Google says Gemini 1.5 Pro can reason about various details from the 402-page Apollo 11 moon mission transcripts. In addition, it can analyze plot points and events from an uploaded 44-minute silent film starring Buster Keaton. “As 1.5 Pro’s long context window is the first of its kind among large-scale models, we’re continuously developing new evaluations and benchmarks for testing its novel capabilities,” Hassabis wrote.

Google is launching Gemini 1.5 Pro with 128,000-token capabilities, the same number at which OpenAI’s (publicly announced) GPT-4 models max out. Hassabis says Google will eventually introduce new pricing tiers that support up to one million-token queries.

Joy Malone via Getty Images

Gemini 1.5 Pro is also adept at learning new skills from information in long prompts — without additional fine-tuning (“in-context learning”). In a benchmark called Machine Translation from One Book, the model learned a grammar manual for Kalamang, a language with fewer than 200 speakers globally that it hadn’t previously been trained on. The company says Gemini 1.5 Pro learned to perform at a similar level as a human learning the same content when translating English to Kalamang.

In a piece of the announcement that will catch developers’ attention, Google says Gemini 1.5 Pro can perform problem-solving tasks across longer code blocks. “When given a prompt with more than 100,000 lines of code, it can better reason across examples, suggest helpful modifications and give explanations about how different parts of the code works,” Hassabis wrote.

On the ethics and safety front, Google says it’s taking “the same approach to responsible deployment” it took with Gemini 1.0 models. That includes developing and applying red-teaming techniques, where a group of ethical developers essentially serve as devil’s advocate, testing for “a range of potential harms.” In addition, the company says it heavily scrutinizes areas like content safety and representational harms. The company says it continues to develop new ethical and safety tests for its AI tools.

Google is launching Gemini 1.5 in early access for developers and enterprise customers. The company plans to make it more widely available eventually. Gemini 1.0 is currently available for consumers, alongside a Pro variant that costs $20 monthly.

This article originally appeared on Engadget at https://www.engadget.com/googles-gemini-15-pro-is-a-new-more-efficient-ai-model-181909354.html?src=rss

YouTube just released a new feature that lets users remix music videos and turn them into Shorts. This allows you to adjust various parameters from a full-length music video to create something wholly unique. Does this sound like TikTok? It definitely sounds like TikTok.

Here’s how it works. Just tap “remix” on a music video. You’ll be presented with four options: Sound, Green Screen, Cut and Collab. You can only pick one, so choose wisely. The Sound tool does what you think. It strips the audio and lets you use it in your own YouTube Short. This is the kind of thing that’s hugely popular on TikTok, with many users lip-syncing to various audio clips. This Sound tool is available to any music video and most songs that were automatically uploaded to the platform.  

Green Screen takes things a step further. It turns the video into a background, which you can then dance in front of or whatever. The Cut tool just clips out a five second portion of the video that you can add to any Short. Finally, Collab creates a side-by-side video that places your Short next to the original content. YouTube says this is the perfect option when “you and your friends” want to show off choreography alongside the original artist.

The feature’s already available on the mobile app, though it may not have rolled out to every user yet. If you want to check, just open the app, click on a music video and look for that “remix” option. It’s worth noting that many of these features were already available to Shorts creators, but not in one handy tab.

YouTube/Lawrence Bonk

YouTube Shorts was already a TikTok-alike when it released back in 2021, but these features make it even more, uh, TikTok-ier. With that in mind, YouTube picked the perfect time to officially launch the toolset. Universal Music has pulled its roster from TikTok after a breakdown in financial negotiations. UMG artists include Taylor Swift, Drake, Billie Eilish and many more. 

This has forced TikTok creators to swap out music tracks, as anything sourced from Universal is automatically muted. The record label has accused TikTok of wanting to pay a “fraction” of rates offered by other social media sites. YouTube’s Remix tool has access to Universal’s entire roster.

This article originally appeared on Engadget at https://www.engadget.com/youtube-shorts-now-lets-you-chop-up-and-remix-music-videos-180655627.html?src=rss