The future of User Interaction

(making it so Jarvis can do stuff)

Let's wake up

Your brain needs this 🧠

What is J.A.R.I.V.S.?

Just

A

Rather

Very

Intelligent

System

What does Jarvis  do?

Research and Analysis: Retrieves information, runs simulations, and provides strategic advice.

System Control: Manages and automates security, defense systems, and suit operations.

Personal Assistance: Manages Tony’s schedule, handles communications, and controls home automation systems.

Engineering Support: Assists in designing, building, and maintaining technology, especially Iron Man suits.

Combat Assistance: Provides real-time tactical analysis and operates automated defense/offense mechanisms.

Companionship: Engages in conversations, offering humor, advice, and emotional support.

Emergency Response: Handles crises by executing safety protocols and taking autonomous action to protect Tony and his assets.

EVERYTHING

What's a Jarvis Experience?

Multi-modal: Text, Voice, Video, Gestures

Everywhere: Same assistant for house, phone, car, suit

Immediate response: Responds instantly, even if the actual task requires time to complete

Natural Language: Uses context to understand intent of commands issued with natural language

Proactive: Monitors and takes action and anticipates needs

No Configuration: Manages integrations automatically and dynamically

The Paradigm Shift

Today:

Browsers

Websites

Future:

"Jarvis" Clients

MCP Services

What can we not do

That Jarvis did?

Nothing*

*well... maybe not the SHEILD, FBI, and CIA database stuff, but not for technical reasons

and maybe not the holographic stuff I guess 😅

So why don't we each already have a Jarvis?

Integrations

Model Context Protocol (MCP)

🤖

History and Architecture

Phase 1

Answers questions 🤯

Can't do anything ☹️

Phase 2

Can do stuff 🤯

Can't do enough ☹️

Phase 3

Can do ANYTHING 🤯

Clients aren't all ready 🙁

...  yet 🤩

Architecture

Clients

Servers

Resources

  • The game-changing potential of Model Context Protocol
  • How LLMs Change User Onboarding
  • The cost-effective promise of Model Context Protocol (MCP)
  • Introducing the Epic Workshop MCP
  • Solving tool overload: A vision for smarter AI assistants
  • MCPs: The Natural Evolution of CLIs
  • Letting AI Interface with Your App with MCPs
  • Let's talk about "Tool Poisoning"

    ... + more and counting

Resources

You are great!

Thank you!