Integration of AI, IoT and Big Data: The Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors.  The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT. Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly. 


The Evolution of These Technologies Is Clearer

The IoT Tower of Proprietary Babble Is Slowly Crumbling

The Rise of the Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors.  The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT.” Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly. 

 

One of the most important factors influencing these positive developments has been the recognition of the importance of this technology area by major corporate players and a large number of entrepreneurial companies funded by venture investment, as shown in the infographic above. Amazon, for example, announced in October 2018 that it has shipped over 100 Million Echo devices, which effectively combine an intelligent assistant, smart hub, and a large-scale database of information. This does not take into account the dozens of other companies which have launched their own entries. I like to point to Philips Hue as such an example of corporate strategic focus perhaps changing the future corporate prospects of Philips, based in Eindhoven in the Netherlands. I have visited Philips HQ, a company trying to evolve from the incandescent lighting market. Two years ago my wife bought me a Philips Hue WiFi controlled smart lighting starter kit. My initial reaction was disbelief that it would succeed. I am eating crow on that point, as I now control my lighting using Amazon’s Alexa and the Philips Hue smart hub. The rise of the “intelligent assistant” seems to have been a catalyst for growth and convergence. 

The situation with proprietary silos of offerings that do not work well or at all with other offerings is still frustrating, but slowly evolving. Amazon Firestick’s browser is its own awkward “Silk” or alternatively Firefox, but excluding Google’s Chrome for alleged competitive advantage. When I set up my Firestick, I had to ditch Chromecast because I only have so many HDMI ports. Alexa works with Spotify but only in one room as dictated by Spotify. Alexa can play music from Amazon Music or Sirius/XM on all Echo devices without the Spotify limitation. Which brings me to another point of aggravation: alleged Smart TV’s. Not only are they not truly “smart,” they are proprietary silos of their own, so “intelligent assistant” smart hubs do not work with “smart” TV’s. Samsung, for example, has its own competing intelligent assistant, Bixby, so of course, only Bixby can control a Samsung TV. I watched one of those YouTube DIY videos on how you could make your TV work with Alexa using third-party software and remotes. Trust me, you do not want to go there. But cracks are beginning to appear that may lead to a flood of openness. Samsung just announced at CES that beginning in 2019 its Smart TV’s will work with Amazon Echo and Google Home, and that a later software update will likely enable older Samsung TV’s to work with Echo and Home. However, Bixby will still control the remote.  Other TV’s from manufacturers like Sony and LG have worked with intelligent assistants for some time. 

The rise of an Internet of Everything Everywhere, the recognition of the need for greater data communication bandwidth, and battery-free wireless IoT sensors are heating up R&D labs everywhere. Keep in mind that I am focusing on the consumer side, and have not even mentioned the rising demands from industrial applications.  Intel has estimated that autonomous vehicles will transmit up to 4 Terabytes of data daily. AR and VR applications will require similar throughput. Existing wireless data communication technologies, including 5G LTE, cannot address this need. In addition, an exploding need for IoT sensors not connected to an electrical power source will require more work in the area of “energy harvesting.” Energy harvesting began with passive RFID, and by using kinetic, pizeo, and thermoelectric energy and converting it into a battery-free electrical power source for sensors. EnOcean, an entrepreneurial spinoff of Siemens in Munich has pioneered this technology but it is not sufficient for future market requirements.  

Fortunately, work has already begun on both higher throughput wireless data communication using mmWave spectrum, and energy harvesting using radio backscatter, reminiscent of Nikola Tesla’s dream of wireless electrical power distribution. The successful demonstration of these technologies holds the potential to open the door to new IEEE data communication standards that could potentially play a role in ending the Tower of Babble and accelerating the integration of AI, IoT, and Big Data.  Bottom line is that the market and the technology landscape are improving. 

READ MORE: IEEE Talk: Integrated Big Data, The Cloud, & Smart Mobile: One Big Deal or Not? from David Mayes

My IEEE Talk from 2013 foreshadows the development of current emerging trends in advanced technology, as they appeared at the time. I proposed that in fact, they represent one huge integrated convergence trend that has morphed into something even bigger, and is already having a major impact on the way we live, work, and think. The 2012 Obama campaign’s sophisticated “Dashboard” application is referenced, integrating Big Data, The Cloud, and Smart Mobile was perhaps the most significant example at that time of the combined power of these trends blending into one big thing. 

READ MORE: Blog Post on IoT from July 20, 2013
homeautomation

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so-called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet-connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence, there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise.  The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for.  These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

Vancouver company Energy Aware making Big Waves in Internet of Things

I met today with Ali Kashani and Janice (pronounced “Janeece”) Cheam of Energy Aware in their offices in Chinatown, East Vancouver. Ali is a UBC Vancouver Engineering Ph.D, and Janice is a Sauder “BComm” graduate. Together, they are the brains behind Energy Aware’s novel approach to the “hairball” of the Internet of Things. I began our meeting as a skeptic, and came away impressed with their approach, their market savvy, their chemistry as a team, and the big name partners they have already attracted.


BCB-Cover-August-20112

I met today with Ali Kashani and Janice (pronounced “Janeece”) Cheam of Energy Aware in their offices in Chinatown, East Vancouver. Ali is a UBC Vancouver Engineering Ph.D, and Janice is a Sauder “BComm” graduate. Together, they are the brains behind Energy Aware’s novel approach to the “hairball”  of the Internet of Things.  I began our meeting as a skeptic, and came away impressed with their approach, their market savvy, their chemistry as a team, and the big name partners they have already attracted.  The problem that Energy Aware faces is one of scale and money. Major global players like Intel, Cisco Systems, Qualcomm and others have decided to focus here as well. That is both good and bad for Energy Aware.  The big dogs have the ability to crush better ideas with money, or to collaborate with Energy Aware, so its anyone’s guess what may happen here.  The market for the Internet of Things is hideously complex, confused and immature, a perfect opportunity for an innovative entrepreneurial team to win, with Vancouver as their setting.

Read more: The Internet of Things: the promise versus the Tower of Babbling Things

Read more: Zigbee wants to be the bluetooth of the Internet of Things: too bad everyone hates it

Read more: New global mega industry battle developing in the Internet of Everything

Vancouver company providing a novel approach to cracking the IoT “Tower of Babble”

Reblogged from The Vancouver Sun

November 14, 2013. 4:21 pm • Section: Digital Life

Ali  Kashani, VP software,  and Janice Cheam, founder of Energy Aware Technology, with pie chart showing household energy use.
Ali Kashani, VP software, and Janice Cheam, founder of Energy Aware Technology, with pie chart showing household energy use.

RECENT POSTS FROM THIS AUTHOR

What has its start as Janice Cheam’s student project at UBC’s Sauder School of Business has turned into an innovative new technology for transforming an ordinary home into a smart home of the future.

Dubbed the Neurio, the technology is contained in a WiFi sensor that connects to your home’s breaker panel, tracking energy use by appliances and other electrical devices and integrating with the cloud and apps enabling consumers to manage everything from turning down the thermostat when they leave the house to reminding them that they left the oven on.

Neurio  has just raised more than $267,000 in  a campaign on the online funding site Kickstarter,  more than double its $95,000 goal.

I paid $129 to the Kickstarter campaign to be among the first consumers to get the Neurio Home package that includes a sensor, access to an online site with apps for managing power use.

According to Cheam, who is president and CEO of Energy Aware, the company that created Neurio, using Neurio could save that $129 and more by encouraging more careful energy consumption.

wattson load breakdown1 Vancouver company helps turn your home into a smart home

“We’ve found and a lot of studies have shown this, when people start to get real time feedback on the way they use energy it really changes the way people behave and how they interact with their appliances,” said Cheam. “At a very basic level there is just this consciousness that my house is actually costing me money right now.

“If I’m going to leave this house it is still going to cost me money so maybe I should turn something off and save money while I do that. That positive feedback reinforces people’s desire to want to waste less energy.”

It worked for  Ali Kashani, vice-president, software for Energy Aware.

Using a prototype of the Neurio in his Vancouver apartment, he cut his annual power bill from $750 a year to $400, an accomplishment that also earned him a $75 rebate  from BC Hydro’s Power Smart program.

Among the power culprits in his home? A stereo amp that was set to demo mode from the store.

“When I started using the sensor I realized even when I hit the off button it was still consuming energy,” he said. “It was costing me about $10 a month and with a simple configuration change that problem was resolved.”

app overview Vancouver company helps turn your home into a smart home

In the case of another family using the sensor, the software was able to determine that the household’s Saturday laundry was costing them much more than it should.

“One of the things we were able to detect really easily was that their dryer was really inefficient because you could tell how much energy it was consuming every time they ran a load,” said Cheam. “We could not only alert the customer to how much energy his laundry was using but we were also able to compare it to the community and show him how much more his dryer was costing in power.”

Neurio uses algorithms to track power usage and like the Nest Thermostat, learns over time.