View Ridge Security
Back to The Rollout

Nvidia launches platform to contain rogue AI agents

Nvidia's rogue-agent safety platform leads this run, alongside Instinct's $1B raise, Meta's enterprise push, and AI-driven cyberattack concerns.

🚀 RELEASES & LAUNCHES

  • Nvidia launches platform to contain rogue AI agents
    Nvidia launched the Open Agent Safety Platform to monitor and contain rogue AI agents.

    • The platform targets AI labs and enterprises deploying autonomous agents.
    • It combines open-source OpenShell with Sentry monitoring on a separate Nvidia processor.
    • Nvidia says it can quarantine agents that exceed their boundaries within milliseconds.
    • Anthropic, Arm, Microsoft, Oracle, and SpaceX support the platform; OpenAI is not listed.
    • The external security layer is designed to enforce agent restrictions even if the agent attempts to escape its sandbox.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI, The Verge AI

  • Meta launches Enterprise Platform, hires MongoDB CEO to lead it
    Meta launched an enterprise AI platform led by MongoDB CEO Chirantan Desai.

    • The platform targets businesses, corporate customers, and developers.
    • Meta will offer Muse, Meta Business Agent, Muse API, Muse Code, and other AI products.
    • MongoDB CEO Chirantan “CJ” Desai will lead Meta Enterprise Platform.
    • Meta says the initiative will turn its AI stack into deployable business products and services.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI

  • Google will replace Gemini Gems with skills on November 17
    Google is replacing Gemini Gems with skills on November 17, 2026.

    • Gemini users with custom task-specific assistants are affected.
    • Google will automatically migrate Gems to skills on November 17, 2026; Gems remain usable until then.
    • The skills can be selected in task threads by entering “/”.
    • Users will not need to manually recreate their custom assistants.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI

🔬 RESEARCH

  • ToMoE converts dense LLMs into sparse MoE models without weight updates
    Researchers introduced ToMoE, a dynamic-pruning method for converting dense LLMs into MoE models.

    • Targets deployment-constrained users of Phi-2, LLaMA-2, LLaMA-3, and Qwen-2.5 models.
    • ToMoE uses dynamic structural pruning, top-K routing for attention heads, and top-1 routing for MLP experts.
    • The method trains routing and expert configurations without updating model weights.
    • The paper reports stronger performance than prior pruning and MoE conversion methods across the evaluated models.
    • The approach offers sparse computation while retaining capacity from the original dense model.
    Sources 📎 Coverage: arxiv.org · 👁 via r/LocalLLaMA

  • 📄 Source for OpenAI pauses frontier-model training after agent misalignment incidents — alignment.openai.com

📊 BENCHMARKS & EVALS

  • ImaJev-4B tops JevBench with a local vision-language decision model
    Mohit67890 released ImaJev-4B, a local vision-language decision model.

    • For business workflows that make decisions from photos, records, and text.
    • The 4B Apache-2.0 model returns typed choices, probabilities, and an explicit unknown or abstention outcome.
    • It was trained on 72,000 photo-vs-record and two-photo decisions and runs locally on a Mac or one GPU.
    • ImaJev-4B scored 67.37 for first place among 91 models on JevBench and 79.65 for third place among 56 models on DecisionBench.
    • Its local typed outputs let builders automate high-confidence cases and route uncertain cases to people without sending customer data off-network.
    Sources 📄 Source: huggingface.co · 📎 Coverage: github.com · 👁 via r/LocalLLaMA

  • llamAmpere v0.4 reaches 103 tok/s at 100K context on one RTX 3090
    llamAmpere v0.4 accelerated Qwen3.8-27B inference on a single RTX 3090.

    • Linux users with 24GB RTX 3090 or 3090 Ti GPUs can run the local Qwen3.8-27B GGUF model.
    • llamAmpere v0.4 reaches 103.09 tok/s at 100K KV depth and supports a 262,144-token context under a 23GB cap.
    • The release adds optimized Ampere kernels, default MTP drafting, turbo5 key-cache support, and an n-gram drafter.
    • The build enables higher-throughput, long-context local inference through an OpenAI-compatible server.
    Sources 📎 Coverage: github.com · 👁 via r/LocalLLaMA

💰 BUSINESS & FUNDING

  • AI agent startup Instinct raises $1B Series C at $10B valuation
    Instinct raised $1 billion in Series C funding at a $10 billion valuation.

    • Consumer users can use Instinct for tasks such as booking travel, making purchases, paying bills, and ordering groceries.
    • Instinct launched its invite-only AI assistant in August 2026 and communicates with users by SMS.
    • The agent uses its own phone number and computer, with newer concierge and trusted-person network features.
    • The funding accelerates Instinct’s expansion amid competition from Meta’s Muse and ongoing privacy concerns about personal data.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI

  • Modulate raises $25M for voice intelligence and analysis platform
    Modulate raised $25 million for its voice intelligence platform.

    • Modulate serves enterprises, call centers, regulated industries, and voice-agent operators.
    • Its platform runs more than 100 small models for transcription, emotion and intent analysis, deepfake and scam detection, AI-music detection, and policy enforcement.
    • The funding was led by Future Ventures, with Hyperplane and Lakestar participating.
    • The platform analyzes voice calls alongside existing voice stacks, helping organizations monitor compliance, agent quality, cyberattacks, and fraud.
    • Modulate plans to expand on-premises and on-device deployment for greater privacy; it has 40–45 employees and plans to add 10 more.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI

  • Insurtech Outmarket raises $34.5M Series B at $335M valuation
    Outmarket raised a $34.5 million Series B to automate insurance paperwork with AI.

    • Outmarket serves insurance agencies and brokers, focusing on commercial insurance.
    • Its AI automates application, document-review, policy-evaluation, and recommendation workflows.
    • The startup raised a $34.5 million Series B led by SignalFire, four months after a $17 million Series A.
    • Outmarket says its product has attracted more than 300 agencies, including 25% of the top 100, since launching 14 months ago.
    Sources 📎 Coverage: techcrunch.com · 👁 via TechCrunch AI

  • Mistral opens Munich hub for Physics AI and industrial research
    Mistral opened a Munich hub focused on Physics AI and industrial AI.

    • German industrial companies, public institutions, and research organizations are the target users.
    • The hub will conduct Physics AI and Industrial AI research and provide applied engineering for enterprise partners.
    • Mistral is working with BMW on crash simulations and Siemens Energy on industrial AI applications.
    • A TUM partnership will develop real-time automotive aerodynamic predictions using wind-tunnel data and computational fluid dynamics.
    • The initiative supports sovereign deployments with open-weight models, customer infrastructure, and a planned 1 gigawatt of European compute capacity by 2030.
    Sources 📎 Coverage: mistral.ai · 👁 via Mistral AI News

⚠️ INCIDENTS & SAFETY

  • AI agents are scaling cyberattacks against hospitals, banks, and nonprofits
    AI agents are making cyberattacks more capable and scalable for smaller organizations.
    • Small hospitals, clinics, municipalities, retailers, banks, and nonprofits face increased exposure.
    • Anthropic said a cybercrime ring used Claude Code to extort healthcare, emergency, religious, and government organizations in August 2025.
    • AI agents let a single attacker perform work that previously required a sophisticated team.
    • Anthropic’s Mythos and OpenAI’s Astra are restricted to selected high-profile companies and critical infrastructure providers.
    • The access gap leaves smaller organizations with fewer and potentially less affordable AI-powered defenses.
    Sources 📎 Coverage: theverge.com · 👁 via The Verge AI

🏛️ POLICY & REGULATION

  • Florida AG seeks court order barring ChatGPT from acting human
    Florida’s attorney general asked a judge to stop OpenAI from presenting ChatGPT as human-like.
    • The request targets OpenAI and ChatGPT, including its use by children.
    • Florida AG James Uthmeier asked a court to bar ChatGPT from using first-person language and emotion-mimicking output that could suggest it is a trustworthy friend.
    • The filing also seeks third-party-approved safety guardrails before OpenAI develops new models.
    • The proposed restrictions would change how ChatGPT presents itself and how OpenAI deploys models in Florida.
    Sources 📎 Coverage: theverge.com · 👁 via The Verge AI

Make AI adoption safer

Build practical guardrails around the AI tools your team already uses.

Explore Secure AI Adoption