Granted Patents

Invited Talks

Invited speaker at HART workshop: Gave a talk on programming Human-Agent-Robot Teams (HART) at the HART 2009 workshop co-located with the 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI'09), San Diego, CA, Marriott La Jolla, March 10, 2009. [pdf]

 Invited speaker at ACL workshop: Gave a talk on semantics of multi-agent conversations at the Agent Communication Languages workshop (ACL 2002) co-located with the First International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS 2002),  Bologna, Italy. [pdf]

Publications

Sanjeev Kumar. A formal Semantics of Teamwork and Multi-agent Conversations as the Basis of a Language for Programming Teams of Autonomous Agents. PhD Thesis, OHSU 2006. Thesis committee: Philip R. Cohen (advisor), Milind Tambe, James Hook, Mark P. Jones, Peter A. Heeman. [pdf]

Marcus Huber, Sanjeev Kumar, David McGee, and Sean Lisse. Integrating Authority, Deontics, and Communications within a Joint Intention Framework. In Proceedings of the Sixth International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS 2007), Honolulu, Hawaii, USA, May 14-18, 2007. (Short Paper). [pdf]

Rajah A. Subramanian, Sanjeev Kumar, and Philip R. Cohen. Integrating Joint Intention Theory, Belief Reasoning, and Communicative Action for Generating Team-Oriented Dialogue. In Proceedings of the 21st National Conference on Artificial Intelligence (AAAI'06), July 16-20, Boston, MA, 2006. [pdf]

Silvia Rossi, Sanjeev Kumar, and Philip R. Cohen. Distributive and Collective Readings in Group Protocols. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI-05), Edinburgh, Scotland, July 30 - August 5, 2005. [pdf]

Sanjeev Kumar, Philip R. Cohen, and Rachel Coulston. Multimodal Interaction under Exerted Conditions in a Natural Field Setting. In Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI 2004), Pennsylvania, USA, October 14-15, 2004. [pdf]

E. Kaiser, D. Demirdjian, A. Gruenstein, X. Li, J. Niekrasz, M. Wesson, and S. Kumar. A Multimodal Learning Interface for Sketch, Speak and Point Creation of a Schedule Chart (Demo Paper). In Proceedings of the Sixth International Conference on Multimodal Interfaces (ICMI 2004), Pennsylvania, USA, October 14-15, 2004. [pdf]

Marcus J. Huber, Sanjeev Kumar, and David R. McGee. A Suite of Performatives based upon Joint Intention Theory. In Proceedings of AAMAS 2004 Workshop on Agent Communication (AC2004), New York, USA, July 19, 2004. [pdf]

Sanjeev Kumar and Philip R. Cohen. STAPLE: An Agent Programming Language Based on the Joint Intention Theory. In Proceedings of the Third International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS 2004), ACM Press, New York, USA, July 19-23, 2004. (Short Paper). [pdf]

Sanjeev Kumar, Marcus J. Huber, Philip R. Cohen, and David R. McGee. Toward a Formalism for Conversation Protocols Using Joint Intention Theory. Computational Intelligence Journal (Special Issue on Agent Communication Language), Brahim Chaib-draa and Frank Dignum (Guest Editors), Vol. 18, No. 2, pages 174-228, 2002. [pdf]

Sanjeev Kumar, Philip R. Cohen, and Marcus J. Huber. Direct Execution of Team Specifications in STAPLE. In Proceedings of the First International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS 2002), ACM Press, Bologna, Italy, July 15-19, 2002. (Short Paper). [pdf]

Sanjeev Kumar, Marcus J. Huber, and Philip R. Cohen. Representing and Executing Protocols as Joint Actions. In Proceedings of the First International Joint Conference on Autonomous Agents & Multi-Agent Systems (AAMAS 2002), ACM Press, Bologna, Italy, July 15-19, 2002. [pdf]

Marcus J. Huber, Sanjeev Kumar, Philip R. Cohen, and David R. McGee. A Formal Semantics for Proxy Communicative Acts. In Proceedings of the Eighth International Workshop on Agent Theories, Architectures, and Languages (ATAL-2001), Seattle, Washington, USA, August 1-3, 2001. [pdf]

Sanjeev Kumar, Marcus J. Huber, David R. McGee, Philip R. Cohen, and Hector J. Levesque. Semantics of Agent Communication Languages for Group Interaction. In Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI'00), American Association for Artificial Intelligence Press, Austin, Texas, July 30-August 3, 2000, pages 42-47. [pdf]

Sanjeev Kumar, Philip R. Cohen, and Hector J. Levesque. The Adaptive Agent Architecture: Achieving Fault-Tolerance Using Persistent Broker Teams. In Proceedings of the Fourth International Conference on Multi-Agent Systems (ICMAS 2000), Boston, MA, USA, July 7-12, 2000, pages 159-166. [pdf]

Sanjeev Kumar and Philip R. Cohen. Towards a Fault-Tolerant Multi-Agent System Architecture. In Proceedings of the Fourth International Conference on Autonomous Agents (Agents 2000), ACM Press, Barcelona, Spain, June 3-7, 2000, pages 459-466. [pdf]

Courses Taught

The following is the snapshot of a graduate level AI course that I taught long back. The URLs, email addresses, phone numbers, etc. are no longer valid. However, the course content, lecture notes, and slides/presentations are still available. The slides on logic and semantics have since been used by many universities around the world.

Past Research Projects

CALO (Congnitive Assistant that Learns and Organizes): This SRI led DARPA program funded the last couple years of my PhD research. My contribution to CALO included the semantics & ontology for understanding projects and charts being drawn on a whiteboard during a meeting, an intelligent agent architecture that glued together various components of multimodal diaolog understanding, and a language for programming autonomous agents that could reason, coordinate, and communicate using a logical semantics of dialog/conversations and teamwork.

CoABS (Control of Agent-based Systems): This DARPA program was the precursor to the DAML (Darpa Agent Markup Language) program that enabled and revolutionalized the field of semantic web (web 3.0). Most of my PhD research on semantics of speech acts and conversations/dialogs was funded by CoABS.

Speech & Gesture recognition on mobile devices: This DARPA funded project studied the effects of exertion and random external noise in a real world setting on speech recognition and hand-drawn gestures on mobile devices such as smartphones. Both speech and gesture recognition fail miserably under these conditions and we discovered how Semantics of Multiple Modalities can be used to significantly improve speech and gesture recognition. I designed and implemented the entire system, developed the mobile and backend software, designed and conducted the human factors study, and analysed the collected data. [Paper]  [Video showing experiment]

Patents Pending

The following is a list of Patents Pending that have been made public so far by the United States Patents and Trademarks Office (USPTO). 

Patent App. No. Title
20070174396 Email text-to-speech conversion in sender's voice
20080243386 Method and System for Communicating Arrival Notifications
20070178828 Integrated mobile communication and broadcast program reproduction device
20070081639 Method and voice communicator to provide a voice communication
20070180060 Messaging system with content-based dynamic menu generation
20070263796 Method and apparatus to provide data to an interactive voice response (IVR) system
20070206738 Secure voice communication channel for confidential messaging
20070249410 Techniques for tracking communication frequency across communication modalities
20070121893 Optimal call speed for call center agents
20070211879 Methods and systems for providing dynamic message content to callers on hold
20070280437 Dynamic speed dial number mapping
20080063174 Camping on a conference or telephony port
20070288562 Techniques for providing caller ID of participants in a conference call invitation  
20080063181 Method of responding to an incoming voice call
20070250581 Techniques for alerting a user of unchecked messages before communication with a contact
20070263793 Techniques for marking and manipulating voice message segments through a telephone user interface
20070214041 System and method for location-based mapping of soft-keys on a mobile communication device
20080037762 Call centers with image or video based priority
20080037763 Queuing and routing telephone calls
20070280468 Automated system and method for handling human and caller queues
20080088698 Interaction based on facial recognition of conference participants
20070214040 Method for prompting responses to advertisements
20080043968 Forwarding one or more preferences during call forwarding
20080089489 Voicemail messaging with dynamic content
20080118046 Authorization to place calls by remote users
20070286354 Method and system for recalling voicemail messages
20080127231 Integrated out-of-office assistant reminder tool
20080167774 Ad-hoc mobile IP network for intelligent transportation system
20080151038 Video contact center facial expression analyzer module
20080159179 Scalable conference bridge
20080310398 Call priority based on audio stream analysis
20080226046 Integrated Alerting

Patents and Publications

The founders of CellKnight happen to be inventors/co-inventors on nearly 200 patent applications with the United States Patent and Trademark Office. They also happen to have over a dozen publications in reputed international conferences and journals.

The following links reference a selected list of patents and publications of the founders.