New Tool Hacks the PsycheMicrosoft Blue Hat summit to feature proof-of-concept for extrapolating a user's emotional state based on his or her online postings
Next time you blog or post an update to your social networking site, consider what the net of all of your online postings could reveal about whats really going on inside your head.
Security researchers Nitesh Dhanjani and Akshay Aggarwal have been researching how your online persona and activity can actually be used to hack into your psyche for intelligence-gathering and even as a way to influence your behavior. Theyll be presenting their work at Microsofts upcoming Blue Hat security summit in October.
This is the next generation of hacking: I want to hack you, not your app, says Dhanjani, who is a senior manager with Ernst & Young.
The researchers are building a prototype emotion dashboard that gathers feeds from a users online presence -- from Flickr, blogs, MySpace, Facebook, Twitter, etc. -- into a single RSS feed that populates the dashboard. The tool is based on Microsofts Silverlight Media Web plug-in, and lets you basically glean a persons emotions based on correlations among his or her online postings and activities.
In its basic form, the dashboard will serve as a visual history that gauges the users mood and emotions in real-time and historically. When the targeted user uses negative words like cry, the dashboard will log a dark color, while a happy word could generate yellow or another bright color. Its almost like those stock market orbs you can buy at Brookstone, he says. You can look at it and derive something about whats going on with that person overall.
Dhanjani says the color graph will use a similar color-coding scheme to that of the We Feel Fine project, a data-collection engine that automatically searches the Web every ten minutes for expressions of human feelings from blogs and social networking sites. It then graphs the mood of the Net in color.
Dhanjani and Aggarwals emotion dashboard prototype also will come with a pulse monitor of sorts, graphing the ups and downs of the targeted users moods online over a period of time. The pulse would show that in the past six months, this user has been upset, and now it looks like something happened, Dhanjani says.
Aside from the creepy voyeuristic aspects of this proof-of-concept, there are the obvious privacy concerns that the researchers are trying to demonstrate. And theres no stopping a social engineer or bad guy from trying to manipulate a targeted users behavior by preying and playing on his or her moods. If you are extremely angry, I can see it in real-time, Dhanjani says. And you can make that person even more upset by leaving a comment on their blog that says I agree with you and I understand because that person pissed me off, too, leading you to think about it more and incite the emotion or encourage an action, he says.
The researchers will show how this remote behavior analysis can be used to create personality profiles, for predicting the targeted users state of mind or possible actions, even before the user is aware that they are feeling sad or depressed. That obviously could be used for the good in a criminal investigation, or abused by criminals or sociopaths.
Im just trying to show a proof of concept that this can be done, Dhanjani says. If you just take what were presenting, it doesnt seem like you could get a real understanding of whats going through [a users] brain, but just adding a few more features could, he says.
One such feature is a trigger, where the dashboard could be set to automatically send the targeted user a manipulative message via comment or their social networking site when they hit a certain emotional threshold to fan the fire, for instance. Dhanjani says he and Aggarwal didnt take the prototype that far, however, due to limited resources.
Another potential risk is data poisoning attacks on social networking sites, he says, with phony profiles aimed at discrediting or smearing someone, for instance. Researchers last week at Black Hat USA demonstrated a similar hack, easily building a convincingly real yet fake LinkedIn profile of security icon Marcus Ranum. (See LinkedIn Hack Demonstrates Ease of Impersonation.)
The message we do not want to send is dont use these social networking apps, he says. But there are some clear privacy implications today as well as some clear benefits for criminal research.
Have a comment on this story? Please click "Discuss" below. If you'd like to contact Dark Reading's editors directly, send us a message.
Kelly Jackson Higgins is the Executive Editor of Dark Reading. She is an award-winning veteran technology and business journalist with more than two decades of experience in reporting and editing for various publications, including Network Computing, Secure Enterprise ... View Full Bio