Starting december twenty eighth on t. W. Technology has made us transparent. Where weve been going. The internet has almost everything about us our sexual preferences and relationships our political opinions but cannot also recognize our feelings. Scientists are trying to find a way to make our feelings technically transparent then looking at facial expressions mind which one justice. The santelli says one of the main centers a percentage into virtual emotions. That we meet up with psychologist skip rizzo and that his client chris markel. Yeah thats knuckle is a woman here and traumatized by his experience and. Afraid dont have a friend with. The approach sounds like somethings fiction instead of using real therapists and this is like avatars exploding better in some case. But is not ready to back his feelings to a machine. The former marine enlisted at the age of seventeen. His missions led him to iraq and afghanistan. Vets i think its hard to relay the experiences of work to other people if they havent been there so its its a deeply personal thing thats most people who actually do combat dont talk about it the ones who were time they were in combat talk about all the time but its very hard to bring up something that was. Really emotionally shaking shaping your life and to express it to somebody who wont understand who doesnt understand the situation they werent there they were getting shot at they dont understand why we would shoot somebody else its not a natural reaction so its very hard for us to to talk about something that you know would. I think were worried about the way people look at us even though were proud of our actions its you know its something were part of but then again its not something we want to boast about actually its chris is about to have his First Encounter with allie the virtual therapist. Hi im ellie thanks for coming in today i was created to talk to people in a safe and secure environment im not a therapist but im here to learn about people and would love to learn about you ill ask a few questions to get us started and please feel free to tell me anything your answers are totally confidential so how are you doing today ok what was your favorite subject in School History like turning about early explorers and travel and do you consider yourself more shy or outgoing in a strange way a little bit of both i think. I think everybodys inherently shy but i overcompensate for by being outgoing and try to meet different people tell me about the hardest decision youve ever had to make it would be. A shoot dont shoot combat environment if its not a instant getting shot at returning fire i think that would be the hardest thing the hardest choice to make and it would have to make whats something you regret. I think taken thought out of life for somebody else something that you sure did i do regret tell me about an event or something that you wish you could erase from your memory. I guess various aspects of the war were present i were hurt or killed i dont want to remember those. I think talking to l. A. Was actually a little easier i mean it was a very abrupt very cold and clinical and yet the parents of you know everything it seemed like a normal person. But it didnt give you the skills to not to talk if youre dealing with it when therapist i guess and that kind of series hesitating youre comfortable most therapists dont want to push push your limits too far so theyll kind of you out say well if you dont focus well talk about as we pushed aside to next time with ellie it was really ok how is why did you do this how come we did that why is this and you felt compelled to answer i think and i think i gave way more in that last thirty minutes that i have and all my systems anywhere else it was definitely work if it worked more conversations with the likes of allie arent supposed to replace doctors theyre supposed to provide initial treatment when there is no actual therapist available the exogenous gestures facial expressions on for we saw all recorded so that early can synchronize her own body language with that of the client that has a more empathetic effect. At the same time nonverbal signals sent by Chris Michael analyzed for indications of posttraumatic stress disorder. How often does he look down how often does he smile and for how long. The. Muscle schneider is twenty four years old than the typical Smartphone User would he revealed his feelings to an avatar of whats already possible for him as for most people sounds like something from the future. But we all give away more about house elves than we think. We spend an average of forty hours a week surfing the internet. Social media connects us to friends around the world we were. Spawned with likes and dislikes. Its practically impossible to say what will happen to own less information. News today is relayed in real time on advices and commented on by millions almost instant make. The good of us do it automatic text analyses also tool for our data algorithms look for keywords that betray emotions and whats called sentiment mining i am. We check our mobile phones up to one hundred fifty times a day and those phones are being designed to check on us to. Using facial Recognition Technology phones can differentiate between people. Researchers are working on how to connect and what facial expression recognition programs and the flood of data from social media. The aim is to make our emotions and virtual relationships transparent. The microphone picks up the pitch and cadence of the voice facial expressions and frequency patterns contained courage that betray whether we are feeling sad angry or enthusiastic for example. The schnabel has written an analysis of the power of emotions on our digital world. How can a computer draw conclusions about whats going on deep inside us. How do algorithms affect our minutes. To two. Who profits from the exposure of our emotions and what made our feelings such a much sought after commodity. If you listen ultimately feelings are the instruments for guidance the navigational instruments of our life they tell us what is pleasant or unpleasant where we want to go from where we want to leave and anybody who can control these feelings naturally has great power over us afterwards. Boston massachusetts our next Destination Center of emotion measurement in the media Lab Scientists are developing gadgets that examine our feelings with the aim of promoting our personal happiness. Rosalynn picart is a ground breaker of the new technologies shes adopted a new approach to researching emotion. Most of the science that was done on a motion until recently was done in laboratories or by taking pencil and paper to people and sitting them down at a table and asking them questions like what does this facial expression mean or showing them images of snakes you know and how arousing is this picture. We find that when we measure emotion in real life when we put the lab on the person instead of the person in the lab that we are discovering things about emotion that we never even knew to look for when we were setting it up in the lab. Smart glasses can tell us about our emotional state in real time. Sensors on the wrist to measure skin temperature and analyze perspiration levels to tell us how a roused we are. Yes spectacles themselves are also equipped with emotion senses that relay information about our stress levels. You only ok. But what exactly do the smart glasses measure. Natasha and have a hand under us trying out the new techniques on themselves in the hope of better understanding their own emotions the key to the smart classes as a generous scope a kind of compass for movement this period is called by a glass and im going to show you how motion sensors inside google glass can capture a very subtle motions of your body with a beating of the heart or a spirit. So what youre going to see now is how we are and we find this out the motions are there with the beating of the heart and here on the top we can see the life scope data gyroscope is a sensor that helps you capture that of of the head and here on the bottom graph we are computing your heart rate and we have that basic amplify in better subtle body motions to estimate the frequency of these getting of your head and if they made your heart rate. The psychological de sac contain information about our stress levels the glasses gauge emotions differently than we humans mathematically rather than empathetically. In addition to the smart glasses students also used a portable camera to track their feelings. In the long term monitoring reveals which events call stress levels to rise often were not even aware of the causes. One of the future directions that im very excited about is that the technology is giving us the ability to make measurements over time that while a person looks like theyre mentally healthy like maybe theyre just a little sad like i dont know if theyre still doing ok. We may be able to predict when somebody is going from doing well to not doing well even before they become very vulnerable and perhaps become seriously depressed. The idea of technically measuring emotion is more than one hundred years old in one thousand nine hundred for the first emotional graph was patented. Do you intend to answer truthfully each question regarding stall and what do you sometimes watched all of the year a lie detector measures Blood Pressure pulse respiration and skin contact. You. Reduce fuel risk or no. Sam. Francisca home to the pioneer of modern emotion recognition. Since nine eleven dr paul ekman teachings have been of crucial importance to us security methods. He is said to be able to decode every emotion and every night just by examining facial expressions. Believe it or not in one nine hundred seventy two receiver a long time ago but there was no tool there is a tool for measuring other aspects of behavior but nothing for the face and it was in some sense a dead end that many scientists had tried and failed it took us eight years. To develop the facial action coding system it was published in one nine hundred Seventy Eight its the Gold Standard its no one has ever charged you care to various a dictionary us it allows you to dissect life move it its or its component parts. Eggman practiced independently moving each of the forty three facial muscles used to express emotion so that he could create practically any expression he wanted. His atlas of emotions details more than ten thousand facial expressions each observable component of facial movement is called an action unit today almost all scientists working on a motion decoding refer to egmont atlas of emotions. Run ill call you b. Is the new star of a motion recognition. The scientist six year old son adam finds it perfectly normal but a computer should understand his facial expressions. Children and teenagers are constantly exchanging Text Messages on the most weekends through their smartphones. The. Joy of the library. Uncle ubi is convinced that there is no stopping this kind of technical communication. So that our feelings dont just disappear into cyberspace she developed a program that can decode facial expressions in real time. One of the most powerful ways that humans communicate emotion is through the face so its everything from enjoyment surprise curiosity empathy and. Basically our face has all these different Building Blocks these action units that map into different facial expressions so for example lip corner poll is action unit twelve and its essentially one of the main components of a smile the brow pharo its action it for its the scoring gator muscle and its you know it creates all these wrinkles here that communicates things like confusion or dislike. And so what weve done is weve used Computer Vision and Machine Learning to build algorithms that can read all these different Building Blocks of our of our face and then map them to a number of emotional states. Can you be and a colleague test whether this automatic emotion recognition can also differentiate between nuances of facial expression. And indeed it can tell the difference between a happy smile and a gloating smirk and tells us what aspects of expressions betray these emotions its. A flash of contempt this is to me even catches fleeting signals that last for just split seconds. You know what. The program has succeeded in cataloguing a huge range of facial expressions for recognition. So far we have collected the Worlds Largest emotion Data Repository over three million face says that are collected from over seventy five countries around the world and its really special because this allows us to train the machine in a more effective way we can give examples of different ethnicities genders and age ranges. The faces come from subjects who watch advertising clips online under the watchful eye of a webcam. The results are a highly lucrative source of revenue for the startup. In real time the Program Shows what emotions are represented by the facial expressions for example fifty percent happiness twenty percent surprise a little bit of curiosity and zero boredom very loosely of course you have a toxic industry has a great interest in being able to read and manipulate our feelings because we stream easy to influence on an emotional level simply because our feet. Things are not rational currently this is why many of these Companies Work to develop more emotional Advertising Campaigns that are even more effective at influencing us to buy a certain product. When pushed into put look at a call from. To berlin where research is are also hot on the trail of our emotions. Psychologist under vine has launched a start up that aims to find even more subtle ways of analyzing the emotional effects of advertisements film trailers and political campaigns. Skin contact have a t. Provides information about what interests us and what sticks in the mind. Instead of cameras electrons record the movement of the facial muscles. If we find something attractive a laugh muscles are automatically activates it. If we find a stimulus negative we frown often without noticing. Reactions take place to quickly and to intuitively for us to use words to describe our motional responses. Not every emotional reaction is visible however emotional reactions are accompanied by the finest muscle contractions in the face and these contractions are so minute that we cannot see them here this is where electro my oprah she comes in by using it we can amplify the tiniest contractions so that we can measure them but from our mess but from mom and that way we can measure emotion. From s. And. Using these data scientists can superimpose a motion curves on advertising clips with split second accuracy. By tracking measures the movements of the eyes and reveals what exactly the subject is looking at at any given moment the curves provide information about what we like and what activates our brains get the secret recipe for a highly successful advertising clip has yet to be discovered. Colors show whether something affects us only leaves us cold. But the machine still cannot tell us why that is so good and theres a fundamental difference in emotion recognition by humans im computer to computers analyze in a sober objective fashion they observe facial expression and such and eventually calculate a value and we humans analyze emotions because we read the emotions of others to adapt to them leighs we know those certain emotions and this exchange in which i am familiar with another person smile and that smile makes me happy or i know when the person is sad it is this exchange that makes us human being to mentally. Can technology d. Code our emotions what actually happens when two people meet henry a life. Were just to each other in myriad minuscule ways reflecting our opposite number and sensing intuitively what makes him or her a tech. Oddly for some when it comes to love many people place their faith in the oracles of the internet dating portals that promise to find the ideal partner for every individual. Perfect matching leisure activities level of Education Family planning the first step is to vet the potential partner without the initial flat. Internet dating portals are big Business Owner asked one hundred Million People are registered on matchmaking sites. These sites need the potential customer to stay true to them first long as possible success is failure anyone who finds a partner is an ex customer. How does that affect our relationships. Thats Online Dating back to an Online Dating turns us into orb jets or even worse products Consumer Products we try to emphasize our best characteristics we present ourselves like a product in the supermarket this creates unbeliever. Well the amount of possibilities i bought we are just one product among many and that makes it very difficult to reach a decision and even when weve made a decision it always seems as if there is an even better product out that. One outlook is that through the internet relationships may not last as long but theyll be happier and it still takes real life situations to clarify whether the chemistry between two people is right. When two people encounter each other in real life they form opinions of each other in split seconds if they fall in love their hearts really do beat as one. We feel what the other person feels by synchronizing our voices and body language our pulse on our breathing thats how empathy works now scientists want to apply their knowledge to machines giving them personalities. Los angeles here the Film Industry and science managed to create a virtual people and feelings such as at the institute for creative technologies. Light stage acts is the name given to this oscar winning installation of alli d. s and cameras that create highly realistic digital clones of people often of hollywood stars. Touch with a rapid succession of photos with changing light directions faces can be scanned from all sides elaine up to us. Sixty different emotional expressions and mouth and eye movements. Using these pictures the scientists reconstruct three dimensional face models that are true to the original down to the finest pools and wrinkles. And algorithm uses the data to create a digital double it can communicate emotions like a real human being used in facial expressions. The biggest challenge is making the avatars a pan natural rather than a still have machines. To meet this challenge the algorithm is fed countless examples of facial expressions so how to real people express themselves when theyre interested ashamed or jealous. Its hard to distinguish the copy from the original and essence aside the space twin is created. We definitely want to create virtual faces that are realistic enough that we can have an emotional connection to them because we think that a lot of the applications that we want to use virtual characters and as long a virtual teacher a virtual colleague that you will train with for some sort of task if its going to simulate the Human Experience and the effectiveness of working with other people it needs to be able to evoke some of the same emotional and empathic connections. Eventually people created in the bar a tree can do more than any hollywood action hero theyre programmed in such a way that their facial expressions gestures and voices can react to real human beings. Some test acumen beings also have a kind of empathy. They must put them to work as teaches. Test patients. Well im not a real person if thats what youre asking but im based on the personality and experience is a real soldiers and marines im still just a piece of software but im Getting Better all the time so hopefully i can be a helpful piece of software to talk to. Jonathan crouches on the training of how to impart empathy to digital creations. And i interested in how do people create emotional feeling between themselves and could a computer in some sense empathize or at least convey a sense of empathy with another person and what benefits would that have for interaction if if im talking in a medical context would i disclose more information to a person or to a computer in this case if i felt the computer empathize with what i feel and so in my research i try to understand what does a machine need to do to create empathy does it have to understand the content of what youre saying is it simple enough to nod and smile at the right points and then how does that make the interaction better or possibly worth pressing her most. One of questions favorite projects has facing people off against machines and negotiations aimed at sharing something fairly. That was. Home change to make this possible the Digital Business partners have to be able to put themselves in the shoes of the fed in negotiations only that way can they learn to say the right thing at the right moment and signal approval or rejection by nonverbal means. Now thats not going to work for me. Are the experiments give human beings and avatars the time of agreeing who should get the lamps record albums or chess we still go. Well the top choice for me is really the right amount of fire i know that those who go fast over a lot of money through the value was value i like the records too but im most interested in the lamps while the wares are really valuable but i think i have a buyer that could move and pay a pretty good price for those records oh really yeah when people have reports they synchronize with each other they train up the same style of speech and white and white wonder how could you get a computer to do that and basically we do it using learning we study people we instrument people they retract their facial expressions the tone of their voice because a lot of data and then we train an algorithm to predict how would this person respond if this person did that and then we just get a character that can then follow that algorithm and they know that algorithm knows when to nod and one to smile based on its experience of studying all these people what we want and now we still have a stage where the avatar is controlled by humans like a traditional puppet on a string i have a buyer this is a win win situation. Ok what do you think about to be able to respond intelligently the algorithm has some learning today the more possibilities it tries out the more data it can combine and the more complex the avatars behavior will become sounds good so you want the albums you should like the painting i think all the way. So you dont want the painting so one of the challenges that were working with seven thousand different utterances and im trying to respond as naturally as possible so a lot of this is really just an iterative process its a learning process of practicing and its trying to find the utterances that i need as quickly as possible so theres a bunch of different categories that i use really try to optimize the interface so that i can respond and get that i dont see that i want back to the user within about a second if possible. In future it wont just be avatars that can show emotion there are plans to put empathetic robots to work in social environments like clinics schools over time and homes. As a default but this enjoying the progress is impressive fascinating but true empathy is of course Something Else if true empathy means i know the feeling because i know the problem and i am familiar with grief fear or anger a machine isnt it does not experience grief its all in that sense it is never more than a simulation of empathy and if we confuse that with true empathy and we will turn ourselves into machines that go without this decisive human factor of the inside and mentally a component of. In this band we may now a robot that german scientists intend to a quick with an Empathy Program the ultimate aim is to turn it into a teacher. Now teaches geography. Its eyes are cameras with which it observes its students its still learning how to react to different gestures to encourage or motivated students. It must recognize whether they are interested or bored. For a moment. At the moment its about testing whether it is possible to have a robot that responds empathetically and is recognized as such so that a bond is created between robot and pupil you know it doesnt have to be very complicated children can feel understood by a doll that the puppet understands nothing about c. Assumption we are going to forgive them oh it was good when you gave us compliments no youre doing it and i was asked if it made us want to continue playing. The whole movement makes it worse. Now is not supposed to replace the real thing as a classroom assistant it could help children with learning difficulties for example. And this will test several ready shown that children respond better to criticism from a robot and when a teacher points out that harrison low grades. Another reason scientists are aiming to incorporate empathy in technology is so that we do not end up blind to the feelings of others when more and more of our communications take place in the virtual world. Says she on the jets Sherry Turkle says shes already observed a clear loss of empathy among students. That. Psychologist is about geo back is looking for technology that can help people on the autism spectrum who have problems reading the emotions of other people. Joe baca is testing a new type of smart classes that can analyze the facial expressions and gauge the emotions of the person opposite. But the display is still not accurate enough. And steady job and a team have adopted a different strategy for training empathy. Downside. People with autism find it difficult to imitate others they do not reflect other people and ability based not just on following other peoples movements but also on following their emotions. Its a beautiful as ken does this does a lot i think we all know that dancing and making Music Together promotes a sense of community that has its life or for example when we talk to someone else we imitate their gestures and facial expressions well thats what it is promotes a sense of community and strengthens empathy and they ended up in a mechanism behind it is embodied cognition and it helps explain why we simulate the behavior of others. And thats the future then which does weve visibly simulate in imitate their emotions and thoughts what happened in that improves our understanding of the feelings and thoughts of other people stack that food is able to and i mentioned get out. After the dance training tests on the empathetic abilities of those with autism show a clear improvement in that capacity to interpret the emotional expressions of others. In contrast to the smart glasses which only deliver facts about emotions dancing activates a persons own and chill it have abilities a built in program that helps us identify emotions. Ballots in what sort of a god is even despite all the Technical Innovation were seeing right now i think we should go back to our own bodies as a resource for human interaction. God and pettiness and empathy in particular is something engine we take with us from birth to mention boise that people want to dance people want to move together and when we do we create a powerful force and i think research should look more closely at these areas of these about i hear. The. Job it conducted interviews with tango and cup where dances and found that the more two people synchronize their movements with their partners the more empathy is at work id love to. See. The contrast for example to circuit training which has no effect on our empathetic abilities. Scientists have recognized design geist people who suffer from stress at the office can turn to ups for help often via an adhesive digital tattoo or an implanted chip. A voice recording just a few seconds long is enough for a complete analysis of the state of body and mind. If the emotional balance is wrong the app has suggestions exercises and videos to create moments of mindfulness. Success. Its changed meditation stimulates brain areas that strengthen our empathy. This scientific finding has led to a villain in meditation. Meditation is being held up as a cure for digital autism like an upgrade of our mental software as. Much as it is. True empathy is not easily transferred to machines. That is what makes them so fascinating. Computers seem more than many dreamed was possible just a few years ago but they cannot be taught sensual experience we humans are the true experts at intuitively reading the feelings and thoughts of others. In the hague neuropsychologist says and dekker tries to show the magic of empathetic behavior whether scientific demonstration. In a mysterious looking capsule to subjects who are digitally connected gain a new perspective on empathy here. They dont lights up when two people succeed in sending each other neurofeedback and feeling what the other is feeling. A brain wave synchronized without words when we look at each other and put ourselves in someone elses shoes we adopt the same wavelength. Its almost romantic the stronger the common beat the more the capsule lights up and a picture of the opposite number appears on the outside. The club with us on it we should not forget that feelings and emotions are ultimately there for exchange i seldom have a. Feeling on my own it may challenge me with another person off together maybe we cry together feelings are always a means of communication and that poses the question of whether i should prefer to communicate with a machine a robot or with a real human being or to be a smidgen. We humans love to share information and emotions without as we love it so much that we have created technologies to communicate worldwide. Millions upon millions of selfies and smileys transport our feelings in cyberspace. Futurologist say those technologies could lead to a global mega trend towards mindfulness. Why do elephants need this. How does a plastic model turn into a paving stone why do algae make it clear. Good idea kill working in the air and there are people developing Smart Solutions everywhere. Lets inspire each other to the environment magazine ego at africa thirty minutes on t w. Keep tells us stirring stories. It makes us laugh. And try to tremble and smile. Magical images and emotions that comes from. Geno the legacy of every weekend on d w its. Beat the germans new and surprising aspects of life since culture in germany. Us american keep losing takes a look at germany to sink receives at their traditions every day lives and language. So im. Good. W. Dot com the germans. This is news live from pope francis appeals to the worlds conscience this christmas at Midnight Mass in rome he says faith calls upon the faithful to give immigrants a generous welcome the pontiff also compares the plight of todays not to the biblical figures of the