Integration of AI, IoT and Big Data: The Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors. The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT. Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly.

The Evolution of These Technologies Is Clearer

The IoT Tower of Proprietary Babble Is Slowly Crumbling

The Rise of the Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors. The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT.” Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly.

One of the most important factors influencing these positive developments has been the recognition of the importance of this technology area by major corporate players and a large number of entrepreneurial companies funded by venture investment, as shown in the infographic above. Amazon, for example, announced in October 2018 that it has shipped over 100 Million Echo devices, which effectively combine an intelligent assistant, smart hub, and a large-scale database of information. This does not take into account the dozens of other companies which have launched their own entries. I like to point to Philips Hue as such an example of corporate strategic focus perhaps changing the future corporate prospects of Philips, based in Eindhoven in the Netherlands. I have visited Philips HQ, a company trying to evolve from the incandescent lighting market. Two years ago my wife bought me a Philips Hue WiFi controlled smart lighting starter kit. My initial reaction was disbelief that it would succeed. I am eating crow on that point, as I now control my lighting using Amazon’s Alexa and the Philips Hue smart hub. The rise of the “intelligent assistant” seems to have been a catalyst for growth and convergence.

The situation with proprietary silos of offerings that do not work well or at all with other offerings is still frustrating, but slowly evolving. Amazon Firestick’s browser is its own awkward “Silk” or alternatively Firefox, but excluding Google’s Chrome for alleged competitive advantage. When I set up my Firestick, I had to ditch Chromecast because I only have so many HDMI ports. Alexa works with Spotify but only in one room as dictated by Spotify. Alexa can play music from Amazon Music or Sirius/XM on all Echo devices without the Spotify limitation. Which brings me to another point of aggravation: alleged Smart TV’s. Not only are they not truly “smart,” they are proprietary silos of their own, so “intelligent assistant” smart hubs do not work with “smart” TV’s. Samsung, for example, has its own competing intelligent assistant, Bixby, so of course, only Bixby can control a Samsung TV. I watched one of those YouTube DIY videos on how you could make your TV work with Alexa using third-party software and remotes. Trust me, you do not want to go there. But cracks are beginning to appear that may lead to a flood of openness. Samsung just announced at CES that beginning in 2019 its Smart TV’s will work with Amazon Echo and Google Home, and that a later software update will likely enable older Samsung TV’s to work with Echo and Home. However, Bixby will still control the remote. Other TV’s from manufacturers like Sony and LG have worked with intelligent assistants for some time.

The rise of an Internet of Everything Everywhere, the recognition of the need for greater data communication bandwidth, and battery-free wireless IoT sensors are heating up R&D labs everywhere. Keep in mind that I am focusing on the consumer side, and have not even mentioned the rising demands from industrial applications. Intel has estimated that autonomous vehicles will transmit up to 4 Terabytes of data daily. AR and VR applications will require similar throughput. Existing wireless data communication technologies, including 5G LTE, cannot address this need. In addition, an exploding need for IoT sensors not connected to an electrical power source will require more work in the area of “energy harvesting.” Energy harvesting began with passive RFID, and by using kinetic, pizeo, and thermoelectric energy and converting it into a battery-free electrical power source for sensors. EnOcean, an entrepreneurial spinoff of Siemens in Munich has pioneered this technology but it is not sufficient for future market requirements.

Fortunately, work has already begun on both higher throughput wireless data communication using mmWave spectrum, and energy harvesting using radio backscatter, reminiscent of Nikola Tesla’s dream of wireless electrical power distribution. The successful demonstration of these technologies holds the potential to open the door to new IEEE data communication standards that could potentially play a role in ending the Tower of Babble and accelerating the integration of AI, IoT, and Big Data. Bottom line is that the market and the technology landscape are improving.

My IEEE Talk from 2013 foreshadows the development of current emerging trends in advanced technology, as they appeared at the time. I proposed that in fact, they represent one huge integrated convergence trend that has morphed into something even bigger, and is already having a major impact on the way we live, work, and think. The 2012 Obama campaign’s sophisticated “Dashboard” application is referenced, integrating Big Data, The Cloud, and Smart Mobile was perhaps the most significant example at that time of the combined power of these trends blending into one big thing.

READ MORE: Blog Post on IoT from July 20, 2013

The term “Internet of Things” (IoT) is being loosely tossed around in the media. But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so-called machine to machine or M2M communication. The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet-connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED. Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it. Now, years later, Gates’ original home automation is obsolete. The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.” The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess. In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.” I use this term to describe the inability of available technology to meet the market opportunity. Without convergence, there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise. The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for. These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon. It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things. There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet. Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted “Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh? This is the problem in a nutshell. You do not need to be a data communication engineer to get the point. And this is not even close to a full discussion of the problem. There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war. The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture. The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a. Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether. A very cool new technology, energy harvesting, has begun to take off in the home automation market. The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server. The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.” (unquote). It is apparent that this space remains very confused, crowded and uncertain. A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,” becoming available with the transition from analog to digital television. With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols? There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say. Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject. A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues. Taken together, this market is not ready for prime time.

https://www.slideshare.net/mayo615/ieee-talk-integrated-big-data-the-cloud-smart-mobile-big-deal-or-not/mayo615/ieee-talk-integrated-big-data-the-cloud-smart-mobile-big-deal-or-not

The Internet of Things: The Promise Versus the Tower of Hacked Babbling Things

The term “Internet of Things” (IoT) is being loosely tossed around in the media. But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M communication. The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet connected device.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.” The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess. In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.” I use this term to describe the inability of available technology to meet the market opportunity. Without convergence there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Is everyone following all of these acronyms and data comm protocols? There will be a short quiz at the end of this post. (smile)

New Global Mega Industry Battle Developing in the Internet of Everything

It has dawned on me that an entirely new Mega Multidimensional War of Titans is developing, entirely separate and distinct from the mobile smartphone Multidimensional Mega War of Titans. In many ways this new industry war may be more strategic, larger and more valuable than the smart phone war. The emerging new battleground is the Mega Global War of the Internet of Everything. The global players in this newly developing war are well known names in high technology: ARM, Broadcom, Cisco Systems, Intel, and Qualcomm, not to mention a new class of players like The Zigbee Alliance, Honeywell and a host of others. A number of small Canadian companies are also in the thick of this.

Another chapter in my Industry Analysis series

It has dawned on me recently that an entirely new Mega Multidimensional War of Titans is developing, entirely separate and distinct from the mobile smartphone Multidimensional Mega War of Titans. In many ways this new industry war may be more strategic, larger and more valuable than the smart phone war. The emerging new battleground is the Mega Global War of the Internet of Everything. The global players in this newly developing war are well known names in high technology: ARM, Broadcom, Cisco Systems, Intel, and Qualcomm, not to mention a new class of players like The Zigbee Alliance, Honeywell and a host of others. A number of small Canadian companies are also in the thick of this.

Some history

The Internet of Everything has been around for over 20 years and gone absolutely nowhere for lack of “technology convergence” and effective industry “co-opetition.” Definitional confusion has abounded, with terms like “home automation” and “machine to machine” (M2M) communication. The technology convergence issue is now resolved but not the need for “co-opetition.” Despite this, it is estimated that there are already as many as two Billion “Internet of Things” (IoT) devices already out there, though many of them do not yet work. Think of these as “sensors,” each with a microchip of some description, and some form of data communication, not all Internet compatible. The problem with what is out there is what I call “the Tower of Babbling Things.” There is no global industry consensus on how these sensors should communicate, so each competitor has gone forward to establish their own vertical proprietary markets. Layer on top of that multiple data communication protocols that do not talk to each other. The international standard bodies like IEEE and ISO have bravely declared their intent to establish coherence from chaos, but without the major players, their efforts are doomed. The result is a massive market hairball. But the market value projections are so massive (see the Business Intelligence Infographic below) that the biggest global players appear finally to be moving.

The Mega Battlefield Begins to Take Shape.

While some major players have been engaged in the Internet of Everything space for some time, others are only beginning to mobilize their forces.. Intel has this week announced the formation of new Internet of Things division, following Intel’s recent announcement of of new family of “Quark” Internet of Things microprocessors.

This is clearly a very important new technology development for all us, and is very much worth following. It will have an impact and major implications for all consumers and businesses.

The Internet of Everything Outstrips the Smartphone Revolution

The Internet of Everything

Reblogged from SemiWiki.com

Can Intel Compete in the Internet of Things?

by Daniel Nenni

Published on 11-05-2013 03:00 PM

Kevin Ashton, a British technology pioneer, is credited for the term “The Internet of Things” to describe an ecosystem where the Internet is connected to the physical world via ubiquitous sensors. Simply stated: rather than humans creating content for the internet IoT devices create the content. To be clear, this does not include PCs, Smartphones, SmartTVs, or wearable electronics. Think everyday things like thermostats, appliances, parking meters, and medical devices enabling physical-to-digital communication via the internet.

Today there are an estimated 2B IoT devices in play and that number is expected to grow exponentially in the coming years, so yes, this is a big deal.The question I have is this: Does Intel have a chance here or will ARM and the fabless semiconductor ecosystem continue to dominate the IoT market?The annual ARM user gathering was last month and IoT was a major focus. You can read about the ARM and the Internet of Things keynote and visit the ARM TechCon website for more information. My agenda at the conference was gathering 14nm silicon data but I attended the IoT presentations as well and that lead me to where I am today, at the IEEE IoT workshop.“The great promise of the Internet of Things is about the transformation of the world based on the convergence of numerous disjointed systems into a fully connected environment where complex tasks are synchronized and performed by a unified platform,” said Oleg Logvinov, member of the IEEE-SA Standards Board, member of the IEEE-SA Corporate Advisory Group, and director of market development, Industrial and Power Conversion Division withSTMicroelectronics. “During the workshop in Silicon Valley, we will explore how various technologies can be applied across multiple verticals and how convergence is fueling IoT’s endless potential and opportunities.” I also attended the IDF 2013 Forum last September where Intel announced their IoT contender, Quark. For you Star Trek fans Quark was the beloved con man pictured above. For Intel, Quark is a synthesizable core based on the 486 instruction set to which they claim uses 1/10th the power of Atom and is 1/5 the size. This was just slides with little technical data but details are now starting to emerge. The first Quark will be manufactured on a 32nm SoC process. The main problem I see here is that Intel’s 32nm is HKMG which is not cost nor power optimized and will unfavorably compete with TSMC 28nm poly/SION but I digress…. Lets get back to business.

The IoT value proposition is similar to mobile with low power and cost being the primary drivers. Business models and ecosystem are also going to be determining factors. Do you even know what silicon is inside your mobile devices? I do, but most people don’t. Do you even care? I do, but again, you don’t. Is IoT going to be any different? Absolutely not so say good bye to the old school benchmarks and transistor one-upmanship.

Also read: Intel Quark: Synthesizable Core but you can’t have it

The first questions during the IDF Q&A were about Quark and the Intel business model. By definition a synthesizable core can be licensed and customized by the customer. ARM takes this to a deeper level by licensing the architecture and instruction set so customers have complete control over implementation. So the first question to Intel CEO Brian K. was: Will Intel license the Quark cores? The answer was, “No”. Can Quark be manufactured outside of Intel? No. Can customers synthesize Quark? No. Can Intel be successful in the IoT market with their current Quark business model? No (my incredibly biased opinion). Fortunately business models can change faster than technology so Intel still has a chance with IoT and Quark but they had better hurry.

The Internet of Things: The Promise Versus the Tower of Babbling Things

The term “Internet of Things” is being loosely tossed around in the media. But what does it mean? It means simply that data communication like the Internet, but not necessarily Internet Protocol packets is emerging for all manner of “things” in the home: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M. The data communication can also terminate in a home compute server where the information can be made available to the homeowner to intervene remotely from their smart mobile phone or any other remote Internet connected device.

The term “Internet of Things” (IoT) is being loosely tossed around in the media. But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M communication. The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet connected device.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.” The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess. In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.” I use this term to describe the inability of available technology to meet the market opportunity. Without convergence there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

The other problem is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon. It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things. There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet. Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted “Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Is everyone following all of these acronyms and data comm protocols? There will be a short quiz at the end of this post. (smile)

The Evolution of These Technologies Is Clearer

The IoT Tower of Proprietary Babble Is Slowly Crumbling

The Rise of the Intelligent Assistant

Share this:

Share this:

Another chapter in my Industry Analysis series

Some history

The Mega Battlefield Begins to Take Shape.

The Internet of Everything Outstrips the Smartphone Revolution

Can Intel Compete in the Internet of Things?

Share this:

Share this: