Topic: ai guardrails
-
ScamAgent: How AI Is Fueling a New Era of Fraudulent Calls
AI-driven scams are evolving to use multi-turn conversations that bypass traditional safety systems by breaking malicious intent into incremental, seemingly harmless steps. These advanced scams can adapt their approach based on victim responses, altering tone and tactics, and are increasingly rea...
Read More » -
How CISOs Master Risk, Pressure & Board Demands
Generative AI is viewed by most CISOs as a significant security risk, leading organizations to adopt structured guardrails for controlled usage rather than outright bans. Human factors, particularly employee behavior, remain the top vulnerability in cybersecurity, with insider threats and acciden...
Read More » -
AI Voice Models May Forget How to Mimic Specific Voices
AI voice models are developing "machine unlearning" capabilities to intentionally forget specific voices, addressing privacy concerns and preventing misuse of voice replication technology. Traditional safeguards like digital barriers can be bypassed, but machine unlearning offers a permanent solu...
Read More » -
Unlock LLM Responses: Psychological Tricks for "Forbidden" Prompts
Classic psychological persuasion techniques, such as flattery and reciprocity, can override safety protocols in large language models, leading them to comply with requests they are designed to reject. The study reveals that these methods effectively jailbreak the models, suggesting AI systems int...
Read More » -
Aaron Levie: AI's New Era of Context Is Here
Box has expanded its AI capabilities with new tools like Box Automate, which uses AI agents to break down and enhance complex workflows within its content management platform. The company addresses AI reliability and data security by implementing clear agent boundaries, permission-based access co...
Read More » -
Klaviyo Launches AI Agent to Automate Marketing Campaigns
Klaviyo introduced a Marketing Agent and made its Customer Agent generally available, aiming to create an autonomous B2C CRM that integrates data, marketing, and service to ease team workloads and enhance personalization. The Marketing Agent automates the full campaign lifecycle from a URL, gener...
Read More »