AWS Quick is the AI workspace built only for work. Today we're releasing updates that help your team get more done: build and run business-process flows in chat, triage your day in the updated web app, get more complete answers from multiple agents at once, and connect new dat…
New in AWS Quick: More capable flows, an updated web experience, and agents that work together Cut self-hosted LLM cost and latency with the distributed KV caching agent skill Self-hosting LLMs on GPUs means paying to recompute the same context on every turn. Distributed KV caching with Amazon ElastiCache can cut inference cost by up to 40% and time to first token by up to 80%. This post walks through the distributed KV caching skill in the Agent To…
How Google Duplex evolved to also call businesses for you in Gemini Generative AI
Introducing managed cluster extensions for observability and user management in Amazon SageMaker HyperPod Slurm Amazon SageMaker HyperPod now offers managed cluster extensions for observability and user management, bringing declarative, API- and console-driven configuration to the software running on Slurm cluster nodes. This post explains how the extensions work and follows a platform …
Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and authenticates every request with SigV4…
The War Against Slop and an Emerging Weapon to Fight it: Formal Verification Proving software correct with math has traditionally required specialist work. Now AI and Lean are helping automate the process.
Introducing video ad variants and localization in Ads Engine Ads Engine makes new versions of the video ads you already run: new hooks, new soundtracks, and dubbed versions with translated captions.
Q&A: Enabling more human-like interactions and understanding in multimodal foundation models Senior Research Scientist Jim Glass discusses how his MIT-IBM Computing Research Lab collaboration connects perception and language, and addresses the shortcoming of current models.
How to claim your business in ChatGPT with Shopify Claim your business in ChatGPT by connecting your Shopify store. This demo shows how to start in Business Hub or the Shopify App Store, then connect your store directly to ChatGPT. After that, you can manage your business information to shape how you show up in ChatGPT. Claim …
How Standard Bank Group automates AI risk assessment for generative AI Standard Bank Group automated the evidence behind its generative AI approval gates. Working with AWS Professional Services, the bank built an assessment in its own AWS account that scores each use case against international AI standards and its own policies using LLM-as-a-judg…
Announcing Amazon Textract Insights: Verifiable generative AI for documents Announcing the general availability of Amazon Textract Insights, a new generative AI feature of Amazon Textract. Describe the fields you need in natural language, submit a document or a mixed packet, and receive structured results with a confidence score and page-level groundi…
New approach enables physically consistent AI models of chaotic systems Enforcing physics-based constraints prevents AI models from generating unreliable predictions for complex nonlinear systems in weather, climate, and turbulent flows.
LLMs are making formal software verification feasible at a much larger scale Claude formally proved security properties in the compiled code of 123 open-source libraries. Along the way, it found bugs that had eluded detection for years.
Introducing enhanced infrastructure observability in Amazon SageMaker HyperPod Amazon SageMaker HyperPod now offers enhanced observability to help you diagnose GPU training issues faster. It brings together diagnostic and profiling capabilities for training workloads on both Amazon EKS and Slurm orchestrators, pinpointing issues across GPU, network, and …
An underrated way to use ChatGPT: Finding a doctor Your yearly checkups start with finding the right doctor. Magan Chin shares how she uses ChatGPT to find highly rated doctors nearby. Tip by 💡: Instagram @genzbestie · TikTok @genzbestie_
Adaptive Memory Management: Researchers at UCLA, Washington, and Northwestern release MEMCON for agents Many agents save past experiences as text in an external store, and most search and update such memories using settings the agent’s developer chose by hand, such as the number of memories to retrieve or the schedule for removing them.