Integration of AI, IoT and Big Data: The Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors.  The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT. Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly. 


The Evolution of These Technologies Is Clearer

The IoT Tower of Proprietary Babble Is Slowly Crumbling

The Rise of the Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors.  The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT.” Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly. 

 

One of the most important factors influencing these positive developments has been the recognition of the importance of this technology area by major corporate players and a large number of entrepreneurial companies funded by venture investment, as shown in the infographic above. Amazon, for example, announced in October 2018 that it has shipped over 100 Million Echo devices, which effectively combine an intelligent assistant, smart hub, and a large-scale database of information. This does not take into account the dozens of other companies which have launched their own entries. I like to point to Philips Hue as such an example of corporate strategic focus perhaps changing the future corporate prospects of Philips, based in Eindhoven in the Netherlands. I have visited Philips HQ, a company trying to evolve from the incandescent lighting market. Two years ago my wife bought me a Philips Hue WiFi controlled smart lighting starter kit. My initial reaction was disbelief that it would succeed. I am eating crow on that point, as I now control my lighting using Amazon’s Alexa and the Philips Hue smart hub. The rise of the “intelligent assistant” seems to have been a catalyst for growth and convergence. 

The situation with proprietary silos of offerings that do not work well or at all with other offerings is still frustrating, but slowly evolving. Amazon Firestick’s browser is its own awkward “Silk” or alternatively Firefox, but excluding Google’s Chrome for alleged competitive advantage. When I set up my Firestick, I had to ditch Chromecast because I only have so many HDMI ports. Alexa works with Spotify but only in one room as dictated by Spotify. Alexa can play music from Amazon Music or Sirius/XM on all Echo devices without the Spotify limitation. Which brings me to another point of aggravation: alleged Smart TV’s. Not only are they not truly “smart,” they are proprietary silos of their own, so “intelligent assistant” smart hubs do not work with “smart” TV’s. Samsung, for example, has its own competing intelligent assistant, Bixby, so of course, only Bixby can control a Samsung TV. I watched one of those YouTube DIY videos on how you could make your TV work with Alexa using third-party software and remotes. Trust me, you do not want to go there. But cracks are beginning to appear that may lead to a flood of openness. Samsung just announced at CES that beginning in 2019 its Smart TV’s will work with Amazon Echo and Google Home, and that a later software update will likely enable older Samsung TV’s to work with Echo and Home. However, Bixby will still control the remote.  Other TV’s from manufacturers like Sony and LG have worked with intelligent assistants for some time. 

The rise of an Internet of Everything Everywhere, the recognition of the need for greater data communication bandwidth, and battery-free wireless IoT sensors are heating up R&D labs everywhere. Keep in mind that I am focusing on the consumer side, and have not even mentioned the rising demands from industrial applications.  Intel has estimated that autonomous vehicles will transmit up to 4 Terabytes of data daily. AR and VR applications will require similar throughput. Existing wireless data communication technologies, including 5G LTE, cannot address this need. In addition, an exploding need for IoT sensors not connected to an electrical power source will require more work in the area of “energy harvesting.” Energy harvesting began with passive RFID, and by using kinetic, pizeo, and thermoelectric energy and converting it into a battery-free electrical power source for sensors. EnOcean, an entrepreneurial spinoff of Siemens in Munich has pioneered this technology but it is not sufficient for future market requirements.  

Fortunately, work has already begun on both higher throughput wireless data communication using mmWave spectrum, and energy harvesting using radio backscatter, reminiscent of Nikola Tesla’s dream of wireless electrical power distribution. The successful demonstration of these technologies holds the potential to open the door to new IEEE data communication standards that could potentially play a role in ending the Tower of Babble and accelerating the integration of AI, IoT, and Big Data.  Bottom line is that the market and the technology landscape are improving. 

READ MORE: IEEE Talk: Integrated Big Data, The Cloud, & Smart Mobile: One Big Deal or Not? from David Mayes

My IEEE Talk from 2013 foreshadows the development of current emerging trends in advanced technology, as they appeared at the time. I proposed that in fact, they represent one huge integrated convergence trend that has morphed into something even bigger, and is already having a major impact on the way we live, work, and think. The 2012 Obama campaign’s sophisticated “Dashboard” application is referenced, integrating Big Data, The Cloud, and Smart Mobile was perhaps the most significant example at that time of the combined power of these trends blending into one big thing. 

READ MORE: Blog Post on IoT from July 20, 2013
homeautomation

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so-called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet-connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence, there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise.  The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for.  These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

The Internet of Things: The Promise Versus the Tower of Hacked Babbling Things


homeautomation

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise.  The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for.  These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

Energy Aware Riding Wave of Innovation and Investment in Energy Efficiency

In October of 2013, I first met Energy Aware’s management team, led by UBC alumni founders Janice Cheam and VP of Software, Ali Kashani in their modest East Vancouver offices. I had encountered Ali commenting on the Internet of Things (IoT) on LinkedIn, and I challenged his arguments, as the skeptic that I am. Ali very graciously invited me to meet with him to discuss it further. Home automation and its new iteration, IoT, has been around for at least twenty years and had been going absolutely nowhere. Added to that was what I termed “the Tower of Babble,” a term now also used by Qualcomm to describe the data communication hairball in the IoT space. Indeed, Energy Aware had struggled for quite awhile in this immature market. What I learned in that first meeting with Ali and Janice turned this skeptic into a believer, and I have enjoyed the opportunity to work with Al and Janice since that time providing them with tidbits of advice here and there. My gut told me that Energy Aware was on to something with significant potential, as IoT was finally achieving technological “convergence,” and the Big Dogs in Silicon Valley were now gearing up their own IoT efforts. There is a Tsunami coming, and Energy Aware is well-positioned to ride it.


neurioEnergy Aware Neurio Sensor/Data Collection Technology

In October of 2013, I first met Energy Aware’s management team, led by UBC alumni founders Janice Cheam and VP of Software, Ali Kashani in their modest East Vancouver offices.  I had encountered Ali commenting on the Internet of Things (IoT) on LinkedIn, and I challenged his arguments, as the skeptic that I am. Ali very graciously invited me to meet with him to discuss it further. Home automation and its new iteration, IoT, has been around for at least twenty years and had been going absolutely nowhere. Added to that was what I termed “The Tower of Babble,” a term now also used by Qualcomm to describe the data communication hairball in the IoT space. Indeed, Energy Aware had struggled for quite awhile in this immature market.  What I learned in that first meeting with Ali and Janice turned this skeptic into a believer, and I have enjoyed the opportunity to work with Al and Janice since that time providing them with tidbits of advice here and there.  My gut told me that Energy Aware was on to something with significant potential, as IoT was finally achieving technological “convergence,” and the Big Dogs in Silicon Valley were now gearing up their own IoT efforts. There is a Tsunami coming, and Energy Aware is well-positioned to ride it.

aliandjaniceEnergy Aware’s Management Team: CEO Janice Cheam & VP Software Ali Kashani

Reblogged from the Seattle Times:

Energy efficiency becomes hot market for tech companies

Long overshadowed by wind turbines, solar panels and other fashionable machines of renewable power, energy efficiency is sparking innovation and interest from tech entrepreneurs, big-data enthusiasts and Wall Street speculators.

Originally published by Tribune Washington Bureau, July 6, 2014

WASHINGTON — As President Obama pushes ahead on a strategy to confront climate change that relies heavily on energy efficiency, some Americans may see flashbacks of Jimmy Carter trying to persuade them to wear an extra sweater and turn down the thermostat.

The technology world sees dollar signs.

Long overshadowed by wind turbines, solar panels and other fashionable machines of renewable power, energy efficiency has lately become a hot pursuit for tech entrepreneurs, big-data enthusiasts and Wall Street speculators.

They have leveraged multibillion-dollar programs in several states, led by California and Massachusetts, to cultivate a booming industry. This onetime realm of scolds, do-gooders and bureaucrats has become the stuff of TED talks, IPOs and spirited privacy debates.

“This is not about extra sweaters anymore,” said Jon Wellinghoff, a San Francisco lawyer who formerly chaired the Federal Energy Regulatory Commission.

Power companies are tapping databases to profile intensely the energy use of their customers, the way that firms like Target track customer product choices.

 

Google spent $3.2 billion this year to buy Nest Labs, a company that makes thermostats that resemble iPhones and are designed to intuit the needs of their owners. Energy regulators are providing seed capital to startups building such things as waterless laundry machines.

“There was this notion that energy efficiency would never be sexy, never be something people wanted,” said Ben Bixby, director of energy products at Nest, which has attracted employees from Apple, Google and Tesla Motors to its base in Palo Alto, Calif.

“Nest has built this object of desire,” he said.

On hot days, Nest’s technology enables Southern California Edison to precool the homes of customers before the evening rush, helping the utility avoid the need to fire up extra power plants and netting cash rebates for homeowners.

Spending on efficiency technologies and programs soared to $250 billion worldwide last year, according to the International Energy Agency. The agency projects that amount will more than double by 2035.

U.S. power companies have tripled their investment in efficiency programs — funded mainly through ratepayer fees — since 2006, with California spending the most per customer.

Now the Obama administration has made energy efficiency a cornerstone of its plan to slash greenhouse-gas emissions by 2020. The plan, released in May by the Environmental Protection Agency, pushes states to boost efficiency by business and residential power users 1.5 percent each year.

“We are very excited about the EPA proposal,” said Richard Caperton, director of national policy at OPower, a data-mining firm that nudges homeowners to make better energy choices by alerting them when their neighbors are being more efficient. “We think it opens up more opportunities.”

Not long ago, OPower was a small pilot project partnered with the power company in Sacramento, Calif. Now it does business with 90 utilities, including Seattle City Light, and has gone public.

All the mining of data involved in such high-tech efficiency efforts has some privacy advocates concerned.

In California, utilities are required to report when they share consumer data with someone other than the customer and vendors. Records show that last year immigration authorities, drug-enforcement agents and state tax officials issued more than 1,110 subpoenas for records that track energy use of customers in the San Diego area as frequently as every 15 minutes.

Emerging privacy issues will be a focus of a fall conference sponsored by the American Council for an Energy Efficient Economy.

“This is a big deal,” Associate Director Neal Elliott said. “But it is not a big deal unique to energy.”

Those behind the startups said data already collected by retailers and social-media firms create a much bigger potential intrusion. They express confidence that consumers are more likely to be charmed by their innovations than panicked.

So far, most of the efficiency focus has been devoted to what one innovator in the field, Swap Shah, chief executive of FirstFuel in Boston, calls “elephant hunting.”

Utilities seek out their biggest clients, a small group of corporations in energy-intensive industries, audit their operations exhaustively and work with them to cut use. Each audit requires a small army of staff, Shah said.

FirstFuel goes after millions of other commercial customers that don’t get the utilities’ attention. It mines the 36,000 data points of consumption a modern smart meter generates for a building each year and checks it against other data, such as weather histories and images of the building.

The result is a deep energy-use profile that reveals specific areas of waste, including lights left on all night, air conditioning running when workers are not in the building and poorly insulated windows.

The average customer can use the report to cut consumption more than 18 percent, FirstFuel estimates. No auditors need ever set foot on the property.

Entrepreneurs like Shah hope that their software will ultimately be used by big financiers contemplating whether to back retrofits on large commercial buildings. Investors have not always been eager to put money in such projects amid concern that the investments won’t pay for themselves.

A similar innovation includes one recently unveiled by computer engineers at Retroficiency in Boston. Its Building Genome Project gathered all the publicly available data on 30,000 buildings in New York City to show how huge amounts of energy could be saved with slight changes, said CEO Bennett Fisher.

“Millions and millions of dollars have been spent trying to figure out which buildings are inefficient,” Fisher said. “Doing it manually has created a bottleneck. We want to blow open that bottleneck.”

ZigBee wants to be the Bluetooth of the Internet of Things. Too bad everyone hates it.

Originally posted on Gigaom:
Poor ZigBee. As a wireless standard, it has long faced an identity crisis that pitted it against Wi-Fi in the home and proprietary standards or Bluetooth for low-data rates. But as companies such as Comcast(s cmcsa) embrace the connected home and thanks to an acquisition last year, the standard could get…


More on my two earlier posts on the Tower of Babbling Things

REBLOGGED FROM GIGAOM

connected house abstract copy

ZigBee is fighting for its place in the internet of things against Wi-Fi, Bluetooth Low Energy and Z-wave. It has to overcome fragmentation, sneak into user’s homes and keep Bluetooth at bay. Can it do all three.

Poor ZigBee. As a wireless standard, it has long faced an identity crisis that pitted it against Wi-Fi in the home and proprietary standards or Bluetooth for low-data rates. But as companies such as Comcast embrace the connected home and thanks to anacquisition last year, the standard could get its day in the sun and a place in the home.

Meet ZigBee, a confused standard

ZigBee is designed to carry small amounts of data over a mid-range distance and consume very little power. It’s also a mesh networking standard so the sensors can carry other data along to the hub. Its closest analog is the proprietary Z-wave standard that comes on chips made by Sigma Designs.

If you own a Nest thermostatComcast’s recent router or a Hue lightbulb you have ZigBee chips inside your home already.

A ZigBee outlet.

A ZigBee outlet.

But as those devices illustrate, ZigBee has been plagued by interoperability problems. The standard isn’t just the wireless transport mechanism, but a layer of software on top that can create profiles that interfere with different versions of ZigBee profiles. That means that unlike Wi-Fi, two devices that have ZigBee chips might not interoperate.

The ZigBee Alliance is working on this. In an interview last month with Alliance Chairman Tobin Richardson he said that ZigBee is getting more aggressive about policing those who use the ZigBee certification without actually interoperating. That’s going to be amazing, but the next step will be getting those that use ZigBee to want to go through certification.

ZigBee versus Z-wave

And that may require device-maker and consumer demand. But still, things are changing. Cees Links, the CEO of a Holland-based company called Greenpeak Technologies, which supplies ZigBee chips is optimistic. One would expect that, of course, but Links is also the man credited with convincing Steve Jobs to put Wi-Fi inside the Mac, which was a huge step forward for that technology’s adoption.

He’s betting he can do it again with ZigBee. So, while I’ve heard that roughly nine out of ten sensors are using the proprietary Z-wave standard over ZigBee, and more startups are coming out with Bluetooth Low Energy devices that will communicate with handsets, Links is confident that ZigBee still has a place in the developing internet of things. First, off ZigBee is an open standard with multiple vendors, while Z-wave is dominated by one.

The Nest thermostat.

The Nest thermostat.

Second, the Alliance is really safe-guarding that openness now. He points to the acquisition of Ember by Silicon Labs last year as a big turning point for the standard. Not only did it bring a large chipmaker into the mix, something that will assuage the fears of device-makers who might be skittish about trusting a startup for all of their chip needs, but it freed up the ZigBee Alliance to become a true standards organization.

Links says that Ember had really dominated the direction of the Alliance and wasn’t interested in creating a broader ecosystem where other vendor’s chips would interoperate with theirs, but now that Silicon Labs has taken over, the Alliance is focused on broadening adoption of all ZigBee chips, not just Ember’s. So with Greenpeak, Silicon Labs and Texas Instruments all producing silicon Links hopes device-makers will go with ZigBee as opposed to Z-wave.

Sneaking ZigBee into the home

As for the contention that all you need it Bluetooth and Wi-Fi, Links is skeptical that Bluetooth Low Energy can really handle the distance to become an in-home network, as opposed to a personal area network. And Wi-Fi consumes too much energy. So while, executives at Broadcom and Qualcomm are skeptical that you need more thanBluetooth or Wi-Fi, so far service providers and companies deploying in-home sensors are pretty sure ZigBee or maybe Z-wave has a place.

The next step after getting the chips widely used inside homes (the Comcast deployment should help here in the U.S.) will be getting a ZigBee chip inside the smartphone. Since the mobile handset or tablet is the homeowner’s primary method of communicating with sensors in the home, getting such a chip integrated inside would be huge for ZigBee.

Right now, a ZigBee radio must sneak into the home through a hub, router or set top box — making its adoption by homeowners dependent on the service providers and a few early adopters who buy things like the Almond Router, the SmartThings hub or the Revolv hub. That’s why Comcast’s decision to integrate ZigBee in its Xfinity Home gear is so big.

Of course, we’ll know if ZigBee is getting closer to the defacto standard for sensor networks once Qualcomm or Broadcom picks up Greenpeak — or they change their tune on the standard. And then, maybe we’ll see ZigBee make it into the handset or tablet. Of course, given the existing popularity of Z-Wave and the damage of fragmentation in the ZigBee market so far, none of this might happen, but if it’s going to, now’s the time.

Gigaom

Poor ZigBee. As a wireless standard, it has long faced an identity crisis that pitted it against Wi-Fi in the home and proprietary standards or Bluetooth for low-data rates. But as companies such as Comcast(s cmcsa) embrace the connected home and thanks to an acquisition last year, the standard could get its day in the sun and a place in the home.

Meet ZigBee, a confused standard

ZigBee is designed to carry small amounts of data over a mid-range distance and consume very little power. It’s also a mesh networking standard so the sensors can carry other data along to the hub. Its closest analog is the proprietary Z-wave standard that comes on chips made by Sigma Designs.

If you own a Nest thermostat, Comcast’s recent router or a Hue lightbulb you have ZigBee chips inside your home already.

But as those devices illustrate, ZigBee has been plagued…

View original post 677 more words

The Internet of Things: The Promise Versus the Tower of Babbling Things

The term “Internet of Things” is being loosely tossed around in the media. But what does it mean? It means simply that data communication like the Internet, but not necessarily Internet Protocol packets is emerging for all manner of “things” in the home: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M. The data communication can also terminate in a home compute server where the information can be made available to the homeowner to intervene remotely from their smart mobile phone or any other remote Internet connected device.


homeautomation

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

The other problem is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

The Humble Thermostat: Another Strategic Web Battle


ecobeethermostatThe Ecobee Smart Thermostat, fully Internet capable

For years thermostats have been ugly and downright stupid devices that sit neglected on our walls. But over the past 18 months the connected thermostat has morphed into a gadget that has been drawing the attention of some of the most cutting-edge software startups, which are looking to use it to connect with utilities and consumers.

Unbeknownst to many, a Canadian company in Ontario, Ecobee, has been at the forefront of the smart thermostat market for quite awhile. The Ecobee device is fully integrated with the Internet, and does all of the things you might expect an Internet connected thermostat to do, using your smart phone while away in Zanzibar to monitor your home.  I quite like Ecobee.  But it would be another Canadian innovation tragedy if Ecobee got run over in this growing global battle, as has happened with so many Canadian companies.  I would be happier to see Ecobee begin acting like the global market player it is, attracting  major capital and Big Dog strategic partners.

But the market has been heating up for some time and many major technology players and lots of big Silicon Valley money are now in the fray.  A BC Hydro trial of advanced Smart Grid, solar heating, and Smart Meter (called Advanced Meter Initiative or AMI in BC) technologies has been going on quietly for some time on Vancouver Island. Another FortisBC trial is due to begin in the Okanagan sometime in the near future.  Home energy management networks are set to grow from being in 2 percent of U.S. households in 2011 to 13 percent, or about 16.2 million households, by 2015.

Intel-Intelligent-Home-Energy-ManagementIntel Intelligent Home Management Console, a reference design for OEM’s

Cisco Systems, General Electric, Google, Honeywell, Microsoft and Intel, along with a host of other companies are now focused on this home energy management market, developing new products and technologies that will be in our homes shortly.  Siemens spin-off startup, EnOcean, and the EnOcean Alliance are also part of this complex market mix.  EnOcean is the current leader in a related technology, “energy harvesting”, which will likely be one of the future major drivers in energy efficiency. Many home appliances are already “Internet ready.”  This is obviously an area of major global corporate competition.

So take another look at that ugly thermostat on your wall. Things are about to change.

For the record, I am not impressed with all of the Luddite hype opposed to smart meters.  One of BC’s environmental celebrities (not David Suzuki) is an opponent of wireless smart meters, citing anecdotal research on the health dangers of radio waves generally, but not on smart meters specifically.    On the one hand, this person decries climate change deniers who refuse to accept science, while he simultaneously denies science on radio signal propagation.  I follow this area of research fairly closely and have yet to see any convincing study that points to health problems with the radio signal propagation of smart meters.  I am a follower of Nikola Tesla, the recently resurrected “father of electrical energy generation and distribution”, who endeavored to dispel superstitions about electricity.  Unfortunately, many of those superstitions persist.

A Khosla Ventures-backed energy analytics startup called Bidgely is the latest to go after the next-gen smart thermostat, and it has told us that it has an agreement with thermostat maker Emerson to commercialize a thermostat in the coming months that syncs with Bidgely’s energy software. Bidgely’s algorithms can take home energy data and section out which appliances in the home are consuming what amount of power, without having extra hardware or sensors on each plug or appliance.

Consumers that can get that type of data can see, for example, if their pool pump is consuming too much energy in the winter time, or if their air conditioning unit is sucking down much more power than the average (see itemized bill). Utilities could offer such a smart thermostat to customers in their areas that want to be included in energy efficiency programs. Emerson’s thermostat wirelessly connects to smart meters or a home router with a Zigbee connection.

screen-shot-2013-01-24-at-5-30-52-pm

The deal between Emerson and Bidgely isn’t all that unique in the rapidly growing energy software sector. Emerson is also working with other software startups like EcoFactor, EnergyHub, and Calico Energy to have its thermostat sync with their software, too.

Next week at a major utility conference called Distributech, all of the energy software startups and large energy giants will be touting their smart, connected thermostats; including both new thermostat models and new services. The thermostat is a unique device. It’s an object that can provide demand response services for utilities, or the collective turning down of utility customers’ energy use during peak times (like a hot summer day in Texas). Software startups like EcoFactor can create algorithms that can do this, without making the climate of a home uncomfortable for the inhabitant.

The thermostat is also the latest device to become part of the growing world of the Internet of Things. In this always-on connected ecosystem, everything gets a connection, all devices are made smarter with software and data and these devices can make human lives easier, more interesting or more efficient.

Nest is one of the few that’s aggressively targeting consumers. Most of the energy startups are aiming for the utility market. One of the better known collaborations around a thermostat maker and an energy software company is between Opower and Honeywell. Honeywell is the giant in the thermostat maker market, and Opower is the leading energy software player.

Make sure to watch the buzz around smart thermostats and the entire market area defined by energy efficiency monitoring and management, in both commercial and home applications.