Voice First Health

In this episode, Teri welcomes Eric Sauvé, the Chief of Product and User Experience at Speebly.Eric has been a serial entrepreneur for years and has started and built numerous startups, some of which were acquired by larger companies. He developed an interest in voice technology somewhere along the journey and ended up co-founding Speebly, a voice assistant program that can be used across multiple platforms. Key Points From Eric!How they are using voice technology (Siri) and the Apple Watch to help with handwashing during the current Covid-19 pandemic.Focusing on SiriTheir initial inspiration was using Siri. The fact that Siri gives users a bunch of web results when she can’t answer a question gave him the idea of creating a seamless hand-off from Siri to the different web properties.That would mean that a user could continue searching using their voice.They have also worked with Google Assistant and Amazon Alexa, but their focus on Siri was informed by the fact that Siri has way more users.Inspiration Behind SpeeblyTheir inspiration is based on the fact that when people are doing anything, they will either want to type or use their voice, and voice is, of course, the best option especially where there is a lot of text input.Siri is a closed ecosystem compared to Alexa and Google on the speaker side of things, but it has a ton of users and an app environment of third-party developers. This is why they focus more on Siri.Their main aim is to make it so that anyone who has an app can take advantage of voice search to drive traffic to their app or so that there can be a seamless handoff where a user asks Siri a question and they can keep talking to the app on their phone.They released a software development toolkit (SDK) that app developers can put in their iPhone or Android projects to serve as the talking interface of their app.The toolkit is also available for Apple watch OS and people can use it without their phones.Helping With the PandemicThey have been aiming at helping people understand that they could use voice in the context of smartphones and the Apple watch.They’ve been working on an in-house app called Handwash Circles to encourage people to not only wash their hands but wash them long enough.It’s a touch-less voice first hand wash timer. A user can say, “Hey Siri, start handwash” and the app will start a countdown timer for the appropriate amount of seconds that one is supposed to wash their hands.They plan on implementing accelerometer and gyroscope features where the app can determine if someone has done a good job washing their hands.The community feature of the app enables circles of people, for example, a person’s workplace to access data on their handwashing activities.Studies have shown that there is an improvement in the quality of hand washing where people have devices on them to monitor their hand washing. They ensure people’s data privacy in different ways.They are currently in the process of onboarding their first 10 organizations that are interested in implementing the use of the app at their workplaces.People can also sign up to be beta testers.Links and Resources in this Episodewww.Speebly.com/circleThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare Bookwww.TheVoiceDen.com

In this episode, Teri welcomes Heather Utzig, the Co-Founder and CEO at Pragmatic Voice, a tech innovation company that combines big data, analytics, tech & creativity to drive businesses.Heather has an extensive background in healthcare having worked for companies like Johnson & Johnson and Eli Lilly & Co with her efforts focused on the rapid growth of their sales and sales teams. She was responsible for managing over 130 field sales and sales managers in the area of Brain Health and Sleep efficacy. Her team won the most awards for sales success. She was awarded the Summit Award for outstanding leadership. She has also been a successful entrepreneur and has helped a lot of people launch businesses in catering, construction, healthcare, etc. She has owned and sold successful businesses, and worked with several technological platforms and implementation projects with companies over the past 10 years. Key Points From Heather!The voice applications they have been developing at Pragmatic Voice, specifically the ones geared towards helping surgeons keep track of instruments in the operating room and so much more.Her Introduction Into VoiceShe was developing a technology with one of her companies and she had requested voice to be developed for it because it was around medical instrumentation in general (they worked with medical instrument service providers and were looking at how to prevent infections through the touching of the instruments so voice would ensure that a lot of the processes were hands-free and mobile).In the process of having that voice application developed, she met her co-founder and learned a lot about voice from him.What They’re Doing In The Healthcare SpaceFrom her healthcare background, she has always considered how voice can be applied to solve the problems in healthcare.The fact that there is a lot of human connection in healthcare, especially when it comes to doctor-patient interactions, makes voice very crucial in ensuring that there’s more effectiveness in the delivery of healthcare.Pragmatic works with healthcare companies, facilities, and even physicians to help them place their applications into voice, and advice them on how that is related to HIPAA (privacy) and other areas. They have developed several voice applications in relation to that.One of those applications is Instrument Voice which works inside a hospital, surgery center, or doctor’s office where there is instrumentation that needs to either be repaired, maintained, sterilized, or logged.Anyone working with the instruments within a healthcare setting can look at an instrument’s history, ask questions, pull out manuals, see videos, and even request repairs through the voice app. Pragmatic is streamlining that whole process to make it easier for the healthcare providers.They also have Instrument Wiki, an application that enables doctors, hospitals, and manufacturers to collaborate on information to help each other out in working with their instruments and assets in the hospital.The applications are built on Amazon Alexa and Google Assistant, with their own proprietary open-source database technology.Most hospitals have had a problem in unifying their biomed and sterilization departments, and Pragmatic’s applications, because of their ease of use, can help in bringing a couple of departments in the hospitals together to work in an easier way. Their PresenceThey have been working with some hospitals in New York and they are working on refining several things with plans to go to full scale market in the next month.Links and Resources in this EpisodePragmatic Voice WebsiteInstrument VoiceThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare Bookwww.TheVoiceDen.com

In this episode, Teri welcomes Ilana Meir, a voice designer and mentor in the voice technology space. Ilana is a conversational interface designer and is one of the leading experts in Voice User Interface (VUI) design specifically at the intersection of voice technology and health. Using her immense knowledge and experience, she thinks critically about the future of voice design in ways only few industry experts do, and she encourages her students to do the same. Ilana was a chapter contributor to the recently released book, Voice Technology in Healthcare. Key Points From Ilana!Her expertise in Voice User Interface (VUI) design and some of the tips she can share.How to design a great voice experience.Getting Into Voice DesignShe came into the field of voice design from a prior background in the fields of anthropology, psychology and marketing.During her period in marketing she wanted so badly to make the transition into product design but she found herself falling into voice design which blended perfectly with her background in strategic communications, her creative thinking and her vocal ability in singing.Ilana thinks the landscape of voice design is gradually shifting in relation to how it used to be historically.Voice design is now attracting a variety of people from different fields such as interaction design.Importance of Voice User Interface DesignShe considers design as the last mile logistics, and in regards to that, she feels that it helps in organization and ensuring everything is in perfect condition for patients.The Voice Design FrameworkHer thoughts on the first step into getting into voice design is doing the correct research and having the perfect understanding of the stakeholder’s side and patients side.In terms of the stakeholder’s side, thinking about their customer base, knowing how they are trying to forge relationships with their patients, the legal considerations, understanding the kind of technology available and understanding the downstream effects that might come along the way are key.On the patients side you need to understand how they are receiving this interaction so you can package it perfectly, think about the patient’s day to day interaction so you can know who’s affected.When it comes to voice design in healthcare, one has to think about it as a strategic communication. With every strategic initiative, a lot of efforts and meetings are put into them, and so the same should be applied when designing a voice experience.Best Practices in Designing for the PatientShe advocates for the creation of a culture of participatory medicine which is achieved by creating a dynamic set up where patients and doctors are equal partners in healthcare delivery.How a computer system will communicate with patients is the second consideration, and the focus should be on questions and other things.When it comes to building rapport with patients, one of the main goals should be to mitigate the presumptions a patient might have regarding the healthcare system.A conversational system should be designed to keep interactions with patients brief, precise, and informative.Links and Resources in this EpisodeIlana on LinkedinThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare Bookwww.TheVoiceDen.com

In this episode, Teri welcomes Dr. Bob Kolock, a retired physician, executive, and active Amazon Alexa skills developer.Dr. Bob Kolock has over 35 years of experience in healthcare delivery. Since retirement, he has had the opportunity to spend more time on things that really interest him. That led him to begin learning JavaScript and the Amazon Alexa development process. To date, he has 5 Alexa Skills certified by Amazon. He is currently working on 2 more and one of the two is very much aligned with his healthcare career. It’s focused on improving the transition of care of patients who have undergone a medical procedure. He will be looking for partners to make this Alexa Skill a routine way to deliver post-procedure care instructions in health care delivery systems.Key Points from Dr. Kolock!Becoming an extremely prolific Alexa skills developer after retirement from the healthcare space.The healthcare oriented suite of skills that he’s developing.Getting in Voice TechnologyHe retired 6 years ago and he had had an idea to build a smartphone tool to help manage foods in the pantry or refrigerator so someone could identify them before they got spoiled. He therefore started learning iOS, Android, JavaScript, and how to create an Alexa skill.His first skill was Food Manager and he initially thought that a bar code scan would give the necessary information in as far as expiration dates were concerned, but they didn’t, so he had to find another way to import the information.His Skills So FarHe has created a variety of 18 Alexa skills, 3 of which are revised, and a number of them have to do with healthcare and behavior change. They also relate to the website that he built to function with his database.One of his most popular skills is called Our Little Secret, and the concept behind it is that a brother or sister gives the user secrets based on what they hear around the user’s house. This plays on the privacy concern but the secrets are fictitious and are meant to be funny.Another one is Wine Jester where the idea is to hold a glass of wine to the smart speaker and it will say what the taste, fragrance, and components of the wine are.Healthcare SkillsOne of his first healthcare skills was Blood Pressure Check, and it’s based on the American Heart Association guidelines. The user tells the skill what their blood pressure reading is and the skill gives them feedback as to where that blood pressure might fall.Another one is My Weigh Loss Coach that helps users track their weight loss goals, and gives them positive or negative feedback based on their results.On his website, one can set up text messages to themselves to help with behavior change, and hence he has a skill called Healthy Text Scheduler that sends users scheduled healthy eating texts.The other one is Track My Dose, which helps people manage the medication they’re supposed to take on an as-needed basis.He also has Kindness Counts, a skill that was inspired by all the negativity that’s been in the world. It helps people focus on the good things that are happening around us.He also has two other skills that are geared towards helping physicians become more efficient so they can deliver care to more patients, and also help patients with their follow up care after a medical procedure.Links and Resources in this EpisodeThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare Bookwww.TheVoiceDen.comDr. Kolock’s email - rakolock1@gmail.comFood ManagerOur Little SecretWine JesterBlood Pressure CheckMy Weigh Loss CoachHealthy Text SchedulerTrack My DoseKindness Counts

In this episode, Teri welcomes Israel Krush, the CEO and Co-Founder at Hyro, a voice platform that allows enterprises to easily add voice capabilities to their websites and mobile apps.Israel is based in Israel, and is a former elite intelligence officer in the Israeli Defense Forces. He studied Computer Science and Statistics, has a background in machine learning. He previously worked as a software engineer for Intel and various startup companies. His company Hyro allows customers to have two-way conversations to simplify their access to relevant information. Starting with healthcare, the software enables organizations to better engage with their existing customers and reduce the cost of customer support.Key Points from Israel!What they’re doing in the voice technology and conversational AI space taking data from various places and serving it up via their AI technology for people to incorporate into their websites, businesses, and other entities.The interesting work they’re doing to help with the COVID-19 pandemic.What Hyro DoesIt’s a plug and play conversational AI platform for healthcare providers.The company is focused on both voice and text as long as it’s natural language.They target enterprises and organizations that have massive amounts of data that is hard to navigate.The most important aspect of their solution is the plug and play.While researching the voice assistant and chatbot market, they learned that a lot of the existing solutions are based on a creation platform.Hyro gives their users a creation platform where they can define their intents and build their workflows or conversational flows. They discovered that there was a lot of friction in the deployment and maintenance of their platform for users, so they decided to look for a plug and play approach.  One of the main valuable use cases of their solution for healthcare providers has been helping patients find a physician when they need one. They find a physician based on various attributes of the physician.Another use case is in helping patients find the services that a healthcare provider offers.The patients and other users can interact through various modes and devices. Most traffic comes from mobile devices through typing (texting).Helping Battle COVID-19When the pandemic started, they gathered in conference rooms in all their locations to discuss how they could help with the situation because they knew that patients would have multiple questions regarding the Coronavirus.Based on their technology, they scrapped the certified resources that have answers for questions around COVID-19. They specifically scrapped the WHO and CDC websites, and then constructed a knowledge graph about the virus and released a free chatbot that is also addressing issues around the virus. The chatbot answers frequently asked questions about the virus and gives people a risk assessment based on a short dialogue with a user about their age, where they’re based, whether they’ve interacted with a COVID-19 patient, and other things.Feedback From UsersHyro doesn’t offer a one-fits-all solution. Every healthcare provider has their own unique needs, data sources, and how they handle their patients.With the COVID-19 solution, some healthcare providers have provided additional resources about the virus like their own FAQ webpages.Healthcare providers saw a need for a conversational solution to help patients in getting relevant information. They therefore felt Hyro’s solutions made sense.The Rise of TelemedicinePeople are adopting telemedicine more and more because it has become clear that the old way of healthcare is gone and patients are more willing to use telemedicine.They see the same adoption in the conversational aspect of their solution. Patients are constantly asking how they can schedule a virtual appointment.Links and Resources in this EpisodeThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare BookHyro WebsiteHyro on Linkedinwww.TheVoiceDen.com

In this episode, Teri welcomes Dave Kemp, a thought leader in the intersection between voice first technology and hearables.Dave is part of a company called Oak Tree Products and they provide medical supplies and devices to the hearing technology industry. He also has a blog called FuturEar.co where he documents the rapid technological breakthroughs that are occurring in the hearables niche, including biometric sensors and voice assistants that are being incorporated into the hearable devices.Key Points from Dave!How he became an expert in hearables and voice technology.The content that he wrote in a chapter of the book, Voice Technology in Healthcare.Concrete examples of case scenarios where voice technology can be used to make a difference in people’s lives.Voice Technology and Hearables: The Origin StoryThe first time he was introduced to voice technology was at one of the first Alexa Conference events. He had gone there because he was researching what would happen with hearables due to that fact that hearing aids were becoming Bluetooth enabled.In 2015/2016, all the hearing aids that were coming to market were Bluetooth enabled and so he started thinking about the app economy and what else could be done technology wise in the hearing aid arena.The person who got him interested in voice technology was Brian Roemmelle when he came across his content on Twitter and read it.Brian talked about voice technology as something that would simplify everything back to the basics such that a four-year-old could communicate with the technology just as a 95-year-old could. That’s what gave Dave the aha moment, and he started to see the potential of smart speakers.He realized that if smart speakers continued to proliferate and people continued to increasingly depend on them for more and more things, then people would probably want that type of functionality on their person. He saw the Bluetooth enabled hearing aids as a potential tech to fulfill that.Voice Technology in Healthcare BookDave wrote a chapter in the book about hearables and how they're becoming enabled. He started by talking about the technical side of it and progressively wrote about how they would impact the end users.There’s been the development of consumer grade devices that have the type of technology that legitimizes them as medical grade wearables and hearables. An example is the Apple Watch. The Apple Watch series 4 even has an ECG monitor.There will be a number of applications and environments where that technology will be applied but Dave is more focused on how the everyday person could build a longitudinal health data set (this refers to how someone can collect data about their health a few times a year through a wearable)He talked a lot about how the devices work through PPG sensors, which are the optical based sensors that are increasingly being placed into different wearable devices, for example, on the underside of an Apple watch.The sensors don’t really capture new things and the machine learning algorithms that are layered on top of them are the ones that create new insights by detecting patterns. Dave talked all about that in the chapter from a data collection standpoint.He also wrote about how voice technology could be layered on top of that. He dived into how that would be impactful to end users, caregivers, and all different types of stakeholders.Links and Resources in this EpisodeThe Comprehensive Flash Briefing Formula CourseVoice Technology in Healthcare Bookwww.FutureEar.coFuture Ear Radio Podcast

In this episode, Teri shares a recording of his recent webinar where Brian Roemmele spoke about some of his ideas and visions for what our world is going to look like using voice technology after the current Coronavirus pandemic.Brian is the man that actually came up with the term “Voice First” and he’s often referred to as the Oracle of Voice and the Modern Day Thomas Edison. He is a scientist, researcher, analyst, connector, thinker, and doer. Over the long winding arc of his career, Brian has built and run payments and tech businesses, worked in media, including the promotion of top musicians, and explored a variety of other subjects along the way.He actively shares his findings and observations across fora like Forbes, Huffington Post, Newsweek, Slate, Business Insider, Daily Mail, Inc, Gizmodo, Medium, Quora (An exclusive Quora top writer for: 2017, 2016, 2015, 2014, and 2013), Twitter (quoted and published), Around the Coin (earliest cryptocurrency podcast), Breaking Banks Radio and This Week In Voice on VoiceFirst.FM that surfaces everything from Bitcoin to Voice Commerce.Key Points from Brian!Where he sees voice making the biggest impact in times like these with the Coronavirus pandemic.How voice technology will change healthcare and life in general as we know it for the better.Brian’s Predictions On The Future Impact Of VoiceWe are going to see a redesign of public interaction surfaces (like over the air hand gestures) and more things interacting with voice.Our devices will also become an interface actuated by voice or touch to open doors, choose locations and elevators, open car doors, and a number of similar things, because people will be galvanized with the thought that there could be some dangerous virus years after the Coronavirus.He recently studied a lot of information about the 1918 pandemic and he was able to dive into the mindset of what happened after the pandemic to determine what changed in society. He was able to come up with some of the similarities between that pandemic and the current pandemic, and determine just how society today will change after the Coronavirus pandemic is over.One of the discoveries that were made after the 1918 pandemic was that copper surfaces had an immediate response in devitalizing or deactivating viruses.Certain minerals and metals also devitalize viruses and bacteria through something called Contact Kill which has been widely known for hundreds of years. People in Sumerian times were actually using silver and copper utensils, which some people saw as a sign of wealth, when in reality the utensils actually killed viruses and bacteria, and made their food more presentable.Brian feels that hospital surfaces and beds should have a copper alloy coding to safeguard against viruses and other pathogens.He thinks that there will need to be a way to diagnose people through voice, and how he sees that happening is through different bio-sensors that will be put on a person when they walk into a hospital and start diagnosing them before a medical attendant gets to see them.He insists that that those biosensor devices must not be on the internet in any way so that they’re never compromised. Those devices will be tuned to a user’s personality, outlook, goals, motivations, and they will notice changes in someone’s sleep patterns, and other things that serve as an early warning system.Brian has looked at several studies on Coronaviruses and realized that there are several early warning systems like sleep pattern disturbances, digestive pattern disturbances, change in temperature, change in heart rate variability, change in blink rate, and other things.There are a number of signs of any virus within a human body, and one of those things is a change in someone’s temperature gradient. If one has a voice first device on them, it can be notified of their change in temperature and take the necessary action.The Catalyst to Overhaul MedicineThe Coronavirus pandemic will be the catalyst to overhaul medicine and Brian highlights the fact that times of crisis are the only times in history that anything changes.He predicts the hospital room and points of contact will change because of the amount of attention we have put on the Coronavirus.He highlights the importance of self-sufficiency within countries in order to ensure that people don’t find themselves in the same kind of trouble they’re in right now with the Coronavirus pandemic, and he feels voice first technology will be a great start towards that.Monitoring People’s Vital Signs to Predict PandemicsBrian says with proper human telemetry, a physician can figure out the health of a person.There are other signs people can use to determine if someone has a virus or whether they are ill.He actually has a voice first AI with cameras that can determine that someone presents like they’re sick.He highlights the fact that if people’s health could be monitored electronically, then we would have an early warning sign of an oncoming pandemic. People are not very good observers of their own health conditions and even with the current healthcare systems no one is ever really sure whether a diagnosis is exact, but with a system of telemetry, we can have accurate diagnosis.It all boils down to being able to collect tons of data that is voice first. A great scenario would be someone asking their voice first device how they are doing, and the device would tell them exactly what their health is like.The Roaring 20s That Will Come Out Of The Current PandemicSociety will be re-organized and there’s going to be more telecommuting.Companies will not need to have a lot of their employees going back to their work stations because they will see a need for them to work from their homes as long as they can do their work. Technology is going to inform that.With properly designed voice devices for the corporate environment, work mates will be able to easily communicate with each other from their different locations.Brian walked into one of his companies in the early 2000s, asked most of the employees to go work from home, and productivity exploded as a result.Before the 1918/1919 pandemic, the average person was not interested in the telephone and the radio, but after the pandemic, they were very interested in both technologies because they were technologies that connected people through strong and meaningful communication.He predicts that as a result of the Coronavirus pandemic there will be a release of productivity, creativity, and socialization. He feels voice technology will lead the way in that.Links and Resources in this EpisodeThe Comprehensive Flash Briefing Formula Coursewww.VoiceFirst.ExpertBrian Roemmele on TwitterBrian Roemmele on QuoraBrian on Linkedin