Integration of AI, IoT and Big Data: The Intelligent Assistant

The Evolution of These Technologies Is Clearer

The IoT Tower of Proprietary Babble Is Slowly Crumbling

The Rise of the Intelligent Assistant

Five years ago, I wrote a post on this blog disparaging the state of the Internet of Things/home automation market as a “Tower of Proprietary Babble.” Vendors of many different home and industrial product offerings were literally speaking different languages, making their products inoperable with other complementary products from other vendors.  The market was being constrained by its immaturity and a failure to grasp the importance of open standards. A 2017 Verizon report concluded that “an absence of industry-wide standards…represented greater than 50% of executives concerns about IoT.” Today I can report that finally, the solutions and technologies are beginning to come together, albeit still slowly. 

 

One of the most important factors influencing these positive developments has been the recognition of the importance of this technology area by major corporate players and a large number of entrepreneurial companies funded by venture investment, as shown in the infographic above. Amazon, for example, announced in October 2018 that it has shipped over 100 Million Echo devices, which effectively combine an intelligent assistant, smart hub, and a large-scale database of information. This does not take into account the dozens of other companies which have launched their own entries. I like to point to Philips Hue as such an example of corporate strategic focus perhaps changing the future corporate prospects of Philips, based in Eindhoven in the Netherlands. I have visited Philips HQ, a company trying to evolve from the incandescent lighting market. Two years ago my wife bought me a Philips Hue WiFi controlled smart lighting starter kit. My initial reaction was disbelief that it would succeed. I am eating crow on that point, as I now control my lighting using Amazon’s Alexa and the Philips Hue smart hub. The rise of the “intelligent assistant” seems to have been a catalyst for growth and convergence. 

The situation with proprietary silos of offerings that do not work well or at all with other offerings is still frustrating, but slowly evolving. Amazon Firestick’s browser is its own awkward “Silk” or alternatively Firefox, but excluding Google’s Chrome for alleged competitive advantage. When I set up my Firestick, I had to ditch Chromecast because I only have so many HDMI ports. Alexa works with Spotify but only in one room as dictated by Spotify. Alexa can play music from Amazon Music or Sirius/XM on all Echo devices without the Spotify limitation. Which brings me to another point of aggravation: alleged Smart TV’s. Not only are they not truly “smart,” they are proprietary silos of their own, so “intelligent assistant” smart hubs do not work with “smart” TV’s. Samsung, for example, has its own competing intelligent assistant, Bixby, so of course, only Bixby can control a Samsung TV. I watched one of those YouTube DIY videos on how you could make your TV work with Alexa using third-party software and remotes. Trust me, you do not want to go there. But cracks are beginning to appear that may lead to a flood of openness. Samsung just announced at CES that beginning in 2019 its Smart TV’s will work with Amazon Echo and Google Home, and that a later software update will likely enable older Samsung TV’s to work with Echo and Home. However, Bixby will still control the remote.  Other TV’s from manufacturers like Sony and LG have worked with intelligent assistants for some time. 

The rise of an Internet of Everything Everywhere, the recognition of the need for greater data communication bandwidth, and battery-free wireless IoT sensors are heating up R&D labs everywhere. Keep in mind that I am focusing on the consumer side, and have not even mentioned the rising demands from industrial applications.  Intel has estimated that autonomous vehicles will transmit up to 4 Terabytes of data daily. AR and VR applications will require similar throughput. Existing wireless data communication technologies, including 5G LTE, cannot address this need. In addition, an exploding need for IoT sensors not connected to an electrical power source will require more work in the area of “energy harvesting.” Energy harvesting began with passive RFID, and by using kinetic, pizeo, and thermoelectric energy and converting it into a battery-free electrical power source for sensors. EnOcean, an entrepreneurial spinoff of Siemens in Munich has pioneered this technology but it is not sufficient for future market requirements.  

Fortunately, work has already begun on both higher throughput wireless data communication using mmWave spectrum, and energy harvesting using radio backscatter, reminiscent of Nikola Tesla’s dream of wireless electrical power distribution. The successful demonstration of these technologies holds the potential to open the door to new IEEE data communication standards that could potentially play a role in ending the Tower of Babble and accelerating the integration of AI, IoT, and Big Data.  Bottom line is that the market and the technology landscape are improving. 

READ MORE: IEEE Talk: Integrated Big Data, The Cloud, & Smart Mobile: One Big Deal or Not? from David Mayes

My IEEE Talk from 2013 foreshadows the development of current emerging trends in advanced technology, as they appeared at the time. I proposed that in fact, they represent one huge integrated convergence trend that has morphed into something even bigger, and is already having a major impact on the way we live, work, and think. The 2012 Obama campaign’s sophisticated “Dashboard” application is referenced, integrating Big Data, The Cloud, and Smart Mobile was perhaps the most significant example at that time of the combined power of these trends blending into one big thing. 

READ MORE: Blog Post on IoT from July 20, 2013

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so-called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet-connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence, there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise.  The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for.  These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted “Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

https://www.slideshare.net/mayo615/ieee-talk-integrated-big-data-the-cloud-smart-mobile-big-deal-or-not/mayo615/ieee-talk-integrated-big-data-the-cloud-smart-mobile-big-deal-or-not

The Internet of Things: The Promise Versus the Tower of Hacked Babbling Things

The term “Internet of Things”  (IoT) is being loosely tossed around in the media.  But what does it mean? It means simply that data communication, like Internet communication, but not necessarily Internet Protocol packets, is emerging for all manner of “things” in the home, in your car, everywhere: light switches, lighting devices, thermostats, door locks, window shades, kitchen appliances, washers & dryers, home audio and video equipment, even pet food dispensers. You get the idea. It has also been called home automation. All of this communication occurs autonomously, without human intervention. The communication can be between and among these devices, so called machine to machine or M2M communication.  The data communication can also terminate in a compute server where the information can be acted on automatically, or made available to the user to intervene remotely from their smart mobile phone or any other remote Internet connected device.

Another key concept is the promise of automated energy efficiency, with the introduction of “smart meters” with data communication capability, and also achieved in large commercial structures via the Leadership in Energy & Environmental Design program or LEED.  Some may recall that when Bill Gates built his multi-million dollar mansion on Lake Washington in Seattle, he had “remote control” of his home built into it.  Now, years later, Gates’ original home automation is obsolete.  The dream of home automation has been around for years, with numerous Silicon Valley conferences, and failed startups over the years, and needless to say, home automation went nowhere. But it is this concept of effortless home automation that has been the Holy Grail.

But this is also where the glowing promise of The Internet of Things (IoT) begins to morph into a giant “hairball.”  The term “hairball” was former Sun Microsystems CEO, Scott McNealy‘s favorite term to describe a complicated mess.  In hindsight, the early euphoric days of home automation were plagued by the lack of “convergence.”  I use this term to describe the inability of available technology to meet the market opportunity.  Without convergence there can be no market opportunity beyond early adopter techno geeks. Today, the convergence problem has finally been eliminated. Moore’s Law and advances in data communication have swept away the convergence problem. But for many years the home automation market was stalled.

Also, as more Internet-connected devices emerged it became apparent that these devices and apps were a hacker’s paradise.  The concept of IoT was being implemented in very naive and immature ways and lacking common industry standards on basic issues: the kinds of things that the IETF and IEEE are famous for.  These vulnerabilities are only now very slowly being resolved, but still in a fragmented ad hoc manner. The central problem has not been addressed due to classic proprietary “not invented here” mindsets.

The problem that is currently the center of this hairball, and from all indications is not likely to be resolved anytime soon.  It is the problem of multiple data communication protocols, many of them effectively proprietary, creating a huge incompatible Tower of Babbling Things.  There is no meaningful industry and market wide consensus on how The Internet of Things should communicate with the rest of the Internet.  Until this happens, there can be no fulfillment of the promise of The Internet of Things. I recently posted “Co-opetition: Open Standards Always Win,” which discusses the need for open standards in order for a market to scale up.

Read more: Co-opetition: Open Standards Always Win

A recent ZDNet post explains that home automation currently requires that devices need to be able to connect with “multiple local- and wide-area connectivity options (ZigBee, Wi-Fi, Bluetooth, GSM/GPRS, RFID/NFC, GPS, Ethernet). Along with the ability to connect many different kinds of sensors, this allows devices to be configured for a range of vertical markets.” Huh?  This is the problem in a nutshell. You do not need to be a data communication engineer to get the point.  And this is not even close to a full discussion of the problem.  There are also IoT vendors who believe that consumers should pay them for the ability to connect to their proprietary Cloud. So imagine paying a fee for every protocol or sensor we employ in our homes. That’s a non-starter.

The above laundry list of data communication protocols, does not include the Zigbee “smart meter” communications standards war.  The Zigbee protocol has been around for years, and claims to be an open industry standard, but many do not agree. Zigbee still does not really work, and a new competing smart meter protocol has just entered the picture.  The Bluetooth IEEE 802.15 standard now may be overtaken by a much more powerful 802.15 3a.  Some are asking if 4G LTE, NFC or WiFi may eliminate Bluetooth altogether.   A very cool new technology, energy harvesting, has begun to take off in the home automation market.  The energy harvesting sensors (no batteries) can capture just enough kinetic, peizo or thermoelectric energy to transmit short data communication “telegrams” to an energy harvesting router or server.  The EnOcean Alliance has been formed around a small German company spun off from Siemens, and has attracted many leading companies in building automation. But EnOcean itself has recently published an article in Electronic Design News, announcing that they have a created “middleware” (quote) “…to incorporate battery-less devices into networks based on several different communication standards such as Wi-Fi, GSM, Ethernet/IP, BACnet, LON, KNX or DALI.”  (unquote).  It is apparent that this space remains very confused, crowded and uncertain.  A new Cambridge UK startup, Neul is proposing yet another new IoT approach using the radio spectrum known as “white space,”  becoming available with the transition from analog to digital television.  With this much contention on protocols, there will be nothing but market paralysis.

Is everyone following all of these acronyms and data comm protocols?  There will be a short quiz at the end of this post. (smile)

The advent of IP version 6, strongly supported by Intel and Cisco Systems has created another area of confusion. The problem with IPv6 in the world of The IoT is “too much information” as we say.  Cisco and Intel want to see IPv6 as the one global protocol for every Internet connected device. This is utterly incompatible with energy harvesting, as the tiny amount of harvested energy cannot transmit the very long IPv6 packets. Hence, EnOcean’s middleware, without which their market is essentially constrained.

Then there is the ongoing new standards and upgrade activity in the International Standards Organization (ISO), The Institute of Electrical and Electronics Engineers (IEEE), Special Interest Groups (SIG’s”), none of which seem to be moving toward any ultimate solution to the Tower of Babbling Things problem in The Internet of Things.

The Brave New World of Internet privacy issues relating to this tidal wave of Big Data are not even considered here, and deserve a separate post on the subject.  A recent NBC Technology post has explored many of these issues, while some have suggested we simply need to get over it. We have no privacy.

Read more: Internet of Things pits George Jetson against George Orwell

Stakeholders in The Internet of Things seem not to have learned the repeated lesson of open standards and co-opetition, and are concentrating on proprietary advantage which ensures that this market will not effectively scale anytime in the foreseeable future. Intertwined with the Tower of Babbling Things are the problems of Internet privacy and consumer concerns about wireless communication health & safety issues.  Taken together, this market is not ready for prime time.

 

China warns Trump against abandoning climate change deal

  “Climate change is not, as rumored, a hoax created by the Chinese.” — Liu Zhenmin, China’s deputy minister of foreign affairs

China likely to fill climate change global leadership void on U.S. departure

We are now seeing the first indications of the consequences of  a Trump withdrawal from the international community. China has seen an opportunity to displace the United States and to advance China’s own aspirations to take a more aggressive and visible leadership role in the COP21 agreement. The simultaneous announcement of the de facto death of the TransPacific Partnership (TPP) has also opened a new opportunity for Chinese hegemony in the Asian economic and geopolitical world. Regardless of the Trumpist views on climate change and foreign trade, we are proverbially cutting off our noses to spite our faces.

Source: China warns Trump against abandoning climate change deal

Beijing pushes for progress to prevent global warming, saying that the world wants to co-operate

 

Delegates at the international climate conference in Marrakesh

NOVEMBER 11, 2016, FINANCIAL TIMES

by: Pilita Clark in Marrakesh

China has warned Donald Trump that he will be defying the wishes of the entire planet if he acts on his vow to back away from the Paris climate agreement after he becomes US president next January.  In a sign of how far the world has shifted in recognizing the need to tackle global warming, Beijing — once seen as an obstructive force in UN climate talks — is now leading the push for progress by responding to fears that Mr. Trump would pull the US out of the landmark accord.

“It is global society’s will that all want to co-operate to combat climate change,” a senior Beijing negotiator said in Marrakesh on Friday, at the first round of UN talks since the Paris deal was sealed last December. The Chinese negotiators added that “any movement by the new US government” would not affect their transition towards becoming a greener economy.

India also joined in the warnings, saying Mr. Trump’s appointment would force countries to reassess an accord hailed as an end to the fossil fuel era.

“Everyone will rethink how this whole process is going to unfold,” India’s chief negotiator, Ravi Prasad, told the Financial Times.

As delegates descend on the Moroccan city of Marrakesh for the latest UN talks on tackling global warming, further progress has been thrown into doubt by the election of Donald Trump, a climate change skeptic, as the next US president.

Recalling the way support for the earlier Kyoto protocol climate treaty crumbled after it was abandoned by another Republican president, George W Bush, Mr. Prasad said he feared the Paris accord could suffer “a contagious disease that spreads” if the US withdrew.

Mr. Trump’s sweeping victory on Tuesday has shaken what had appeared to be an unstoppable bout of global action to tackle climate change in the run-up to the two-week Marrakesh talks, which began on Monday.

Governments struck the first climate deal for aviation in October, just days before agreeing to phase out planet-warming hydrofluorocarbon chemicals used in air-conditioners.

The Moroccan hosts of this week’s talks had been planning a celebratory meeting to cap this unprecedented bout of activity. Instead, organizers awoke on Wednesday morning to find the world’s wealthiest country had a president-elect who has called global warming a hoax, pledged to “cancel” the Paris agreement and vowed to stop US funding of UN climate programs entirely.

“They were in absolute shock,” said one person who saw Moroccan officials on Wednesday morning.

Adnan Amin, the director-general of the International Renewable Energy Agency, said “a sense of helplessness” had pervaded the Marrakesh talks, and “a certain amount of fear”.

The EU and Japan also reaffirmed their commitment to the agreement, which requires all countries to come up with a plan to curb climate change in order to stop global temperatures from rising more than 2C from pre-industrial times.

But neither they nor China were willing to offer extra cuts in greenhouse gas emissions to fill the vacuum a US withdrawal would create, nor additional money for an agreement requiring billions of dollars in public and private funds to be channeled from rich to poor countries to tackle climate change.

At 3am in the morning I started to hear the [US election] results and I said, ‘No, you’re having a nightmare, go back to sleep’. When I got up and realised it was true, I walked around in a daze

“If the US changes its position that would be very serious for us, especially the aspect of the finance,” said Shigeru Ushio, a Japanese foreign ministry official.

As delegates absorbed the ramifications of Mr. Trump’s sweeping victory, many swapped stories of how the result had hit them.

“At 3am in the morning I started to hear the results and I said, ‘No, you’re having a nightmare, go back to sleep’,” said one developing country participant. “When I got up and realized it was true, this was really, really happening, I walked around in a daze. I think a lot of us were.”

The negotiations have continued nonetheless and some countries have been adamant that the US election result should not interfere with a meeting that is due to start negotiating a raft of important rules for how the Paris agreement will operate.

“We’re talking about the big challenge of climate change,” said Russia’s lead negotiator, Oleg Shamanov. “This issue is bigger than life. This is a long-term issue, longer than any mandate of any president of country X or Z, even if that country is a big one.”

The prospect of the US withdrawing from the Paris agreement has been a topic of endless discussion beneath the sun-shaded walkways in the temporary convention center built for the Marrakesh meeting.

A pullout would take four years unless Mr. Trump chose to take the US out of the accord’s parent treaty, the 1992 UN Framework Convention on Climate Change, in which case it could only take a year.

That would be a highly provocative move, said international climate law expert, Farhana Yamin. “It would escalate non-cooperation to the highest level possible.”

But as the first week of the talks drew to a close, a mood of defiance was emerging among some delegates who said past US retreats from UN climate action had only spurred other countries’ determination to unify and proceed.

“The talk in the corridors is, ‘OK, this is not going to stop us from moving forward, we will just redouble our efforts’,” said Hugh Sealy, a lead negotiator for an alliance of small island countries.

“This is still an existential threat,” he said. “I still want to pass on that little house I have on the coast in Grenada to my children and the rest of us are going to have to step up.”

Leonardo DiCaprio’s “Before The Flood” Documentary Free Everywhere

The Urgency of Climate Change Action Made Vividly Real

Leonardo DiCaprio‘s extraordinary two-hour National Geographic documentary is now available for viewing free everywhere, including on this page, YouTube, The National Geographic website, and the National Geographic Channel. Everyone should watch it.  Equally worthwhile is the series The Year of Living Dangerously on National Geographic.  The 2-minute trailer and the full documentary film are below here.

The Years of Living Dangerously on National Geographic:

Krugman Joins The Chorus Urging The Return Of Big Ideas In Technology and Venture Capital

Following my recent blog posts on Reid Hoffman, COP21, and an apparent resurgence of Big Ideas in technology, a growing group of venture capitalists are resurrecting their original mission in industry and the economy. Paul Krugman of the New York Times has also noticed and offers his hope that this trend continues.  Max Marmer, who wrote his now legendary 2012 Harvard Business Review article, “Reversing the Decline in Big Ideas,” has stimulated a broad rethinking on what we should be focusing.  The successful landing of Space X’s Falcon 9 is a hopeful early indication that Elon Musk is one of those on the right track.

Things to Celebrate, Like Dreams of Flying Cars

Reblogged from The New York Times, Opinion Page

Paul Krugman DEC. 25, 2015

In Star Wars, Han Solo’s Millennium Falcon did the Kessel Run in less than 12 parsecs; in real life, all the Falcon 9 has done so far is land at Cape Canaveral without falling over or exploding. Yet I, like many nerds, was thrilled by that achievement, in part because it reinforced my growing optimism about the direction technology seems to be taking — a direction that may end up saving the world.

O.K., if you have no idea what I’m talking about, the Falcon 9 is Elon Musk’s reusable rocket, which is supposed to boost a payload into space, then return to where it can be launched again. If the concept works, it could drastically reduce the cost of putting stuff into orbit. And that successful landing was a milestone. We’re still a very long way from space colonies and zero-gravity hotels, let alone galactic empires. But space technology is moving forward after decades of stagnation.

And to my amateur eye, this seems to be part of a broader trend, which is making me more hopeful for the future than I’ve been in a while.

You see, I got my Ph.D. in 1977, the year of the first Star Wars movie, which means that I have basically spent my whole professional life in an era of technological disappointment.

Until the 1970s, almost everyone believed that advancing technology would do in the future what it had done in the past: produce rapid, unmistakable improvement in just about every aspect of life. But it didn’t. And while social factors — above all, soaring inequality — have played an important role in that disappointment, it’s also true that in most respects technology has fallen short of expectations.

The most obvious example is travel, where cars and planes are no faster than they were when I was a student, and actual travel times have gone up thanks to congestion and security lines. More generally, there has just been less progress in our command over the physical world — our ability to produce and deliver things — than almost anyone expected.

Now, there has been striking progress in our ability to process and transmit information. But while I like cat and concert videos as much as anyone, we’re still talking about a limited slice of life: We are still living in a material world, and pushing information around can do only so much. The famous gibe by the investor Peter Thiel (“We wanted flying cars, instead we got 140 characters.”) is unfair, but contains a large kernel of truth.

Over the past five or six years, however — or at least this is how it seems to me — technology has been getting physical again; once again, we’re making progress in the world of things, not just information. And that’s important.

Progress in rocketry is fun to watch, but the really big news is on energy, a field of truly immense disappointment until recently. For decades, unconventional energy technologies kept falling short of expectations, and it seemed as if nothing could end our dependence on oil and coal — bad news in the short run because of the prominence it gave to the Middle East; worse news in the long run because of global warming.

But now we’re witnessing a revolution on multiple fronts. The biggest effects so far have come from fracking, which has ended fears about peak oil and could, if properly regulated, be some help on climate change: Fracked gas is still fossil fuel, but burning it generates a lot less greenhouse emissions than burning coal. The bigger revolution looking forward, however, is in renewable energy, where costs of wind and especially solarhave dropped incredibly fast.

Why does this matter? Everyone who isn’t ignorant or a Republican realizes that climate change is by far the biggest threat humanity faces. But how much will we have to sacrifice to meet that threat?

Well, you still hear claims, mostly from the right but also from a few people on the left, that we can’t take effective action on climate without bringing an end to economic growth. Marco Rubio, for example, insists that trying to control emissions would “destroy our economy.” This was never reasonable, but those of us asserting that protecting the environment was consistent with growth used to be somewhat vague about the details, simply asserting that given the right incentives the private sector would find a way.

But now we can see the shape of a sustainable, low-emission future quite clearly — basically an electrified economy with, yes, nuclear power playing some role, but sun and wind front and center. Of course, it doesn’t have to happen. But if it doesn’t, the problem will be politics, not technology.

True, I’m still waiting for flying cars, not to mention hyperdrive. But we have made enough progress in the technology of things that saving the world has suddenly become much more plausible. And that’s reason to celebrate.

What the Paris Climate Meeting Must Do

Le Bourget airport just north of Paris is the place where Charles Lindbergh landed the Spirit of St. Louis. That event 88 years ago could now be interpreted as foreshadowing the era of globalization. Tomorrow, the world’s nations will meet there under the banner of the UN Framework on Climate Change (UNFCCC).  COP21, also known as the 2015 Paris Climate Conference, will, for the first time in over 20 years of UN negotiations, aim to achieve a legally binding and universal agreement on climate, with the aim of keeping global warming below 2°C.

Read More: COP21: What’s It All About?

THE NEW YORK TIMES

By THE EDITORIAL BOARD NOV. 28, 2015

In 1992, more than 150 nations agreed at a meeting in Rio de Janeiro to take steps to stabilize greenhouse gases at a level that would “prevent dangerous anthropogenic interference with the climate system” — United Nations-speak for global warming.

Many follow-up meetings have been held since then, with little to show for them. Emissions of greenhouse gases have steadily risen, as have atmospheric temperatures, while the consequences of unchecked warming — persistent droughts, melting glaciers and ice caps, dying corals, a slow but inexorable sea level rise — have become ever more pronounced.

On Monday, in Paris, the signatories to the Rio treaty (now 196), will try once again to fashion an international climate change agreement that might actually slow, then reduce, emissions and prevent the world from tipping over into full-scale catastrophe late in this century. As with other climate meetings, notably Kyoto in 1997 and Copenhagen in 2009, Paris is being advertised as a watershed event — “our last hope,” in the words of Fatih Birol, the new director of the International Energy Agency. As President François Hollande of France put it recently, “We are duty-bound to succeed.”

Paris will almost certainly not produce an ironclad, planet-saving agreement in two weeks. But it can succeed in an important way that earlier meetings have not — by fostering collective responsibility, a strong sense among countries large and small, rich and poor, that all must play a part in finding a global solution to a global problem.

Kyoto failed because it imposed emissions reduction targets only on developed countries, giving developing nations like China, India and Brazil a free pass. That doomed it in the United States Senate. Copenhagen attracted wider participation, but it broke up in disarray, in part because of continuing frictions between the industrialized nations and the developing countries.

The organizers of the Paris conference have learned a lot from past mistakes. Instead of pursuing a top-down agreement with mandated targets, they have asked every country to submit a national plan that lays out how and by how much they plan to reduce emissions in the years ahead. So far, more than 170 countries, accounting for over 90 percent of global greenhouse emissions, have submitted pledges, and more may emerge in Paris.

Will these pledges be enough to ward off the worst consequences of global warming? No. Scientists generally agree that global warming must not exceed 2 degrees Celsius, or 3.6 degrees Fahrenheit, from preindustrial levels. Various studies say that even if countries that have made pledges were to follow through on them, the world will heat up by 6.3 degrees Fahrenheit by the end of this century. That would still be much too high, and it would be guaranteed to make life miserable for future generations, especially in poor low-lying countries. But it would at least put the world on a safer trajectory; under most business-as-usual models, temperature increases could reach 8.1 degrees or higher.

Eventually, of course, all nations will have to improve on their pledges, especially big emitters like China, India and the United States. If the Paris meeting is to be a genuine turning point, negotiators must make sure that the national pledges are the floor, not the ceiling of ambition, by establishing a framework requiring stronger climate commitments at regular intervals — say, every five years. This should be accompanied by a plan for monitoring and reporting each country’s performance. Earlier meetings have done poorly on this score.

Other important items dot the agenda. One is how rich nations can help poorer ones achieve their targets. Another is stopping the destruction of tropical forests, which play a huge role in storing carbon and absorbing emissions. The meeting also seeks to enlist investors, corporations, states and cities in the cause. Michael Bloomberg, who made reducing emissions a priority as mayor of New York, will join the mayor of Paris in co-hosting a gathering of local officials from around the world.

The test of success for this much-anticipated summit meeting is whether it produces not only stronger commitments but also a shared sense of urgency at all levels to meet them.

Iraq About To Flood Oil Market: More Grief Ahead For Canada

Underscoring Goldman Sachs forecast last week of oil prices at or below $50 per bbl until at least 2020, Bloomberg News is today reporting that Iraq is preparing to unleash a flood of new oil within the next few months.  This is very bad news for the price of Western Canadian Select bitumen, and Alberta oil sands producers.  Saudi Arabia’s strategy, together with OPEC, to squeeze high-cost oil producers of oil sands and shale seems to be working.  More pessimistic forecasts of WCS at $25 for an extended period now appear more plausible.  The complex interplay of oil and global economies could also have a reverberating effect on regions on the sharp edge of full-scale recession, including Canada, Europe, Russia and China.

Iraq About to Flood Oil Market in New Front of OPEC Price War
If shipping schedules are correct, a tidal wave of oil is coming.

BLOOMBERG NEWS by Grant SmithJulian Lee
7:37 AM PDT
May 26, 2015

(Bloomberg) — Iraq is taking OPEC’s strategy to defend its share of the global oil market to a new level.
The nation plans to boost crude exports by about 26 percent to a record 3.75 million barrels a day next month, according to shipping programs, signaling an escalation of OPEC strategy to undercut U.S. shale drillers in the current market rout. The additional Iraqi oil is equal to about 800,000 barrels a day, or more than comes from OPEC member Qatar. The rest of the Organization of Petroleum Exporting Countries is expected to rubber stamp its policy to maintain output levels at a meeting on June 5. While shipping schedules aren’t a promise of future production, they are indicative of what may come. The following chart graphs planned tanker loadings (in red) against exports.

As in previous months, Iraq might not hit its June target – export capacity is currently capped at 3.1 million barrels a day, Deputy Oil Minister Fayyad al-Nimaa said on May 18. Still, any extra Iraqi supplies inevitably mean OPEC strays even further above its collective output target of 30 million barrels a day, Morgan Stanley says. The following chart shows OPEC increasing output in recent months against its current target.

Defying the threat from Islamic State militants, Iraq has been ramping up exports from both the Shiite south – where companies like BP Plc and Royal Dutch Shell Plc operate – and the Kurdish region in the north, which last year reached a temporary compromise with the federal government on its right to sell crude independently.

Naomi Klein: Shocks, Slides and Shifts Make This The Perfect Time to Invest In Renewables

Imagine if Canada was implementing environmental policies like those proposed by one of its own, author & filmmaker Naomi Klein. What if Canada were to restore its historical image as a progressive country leading the World with its policies?  In the following video published on the UK Guardian website, Ms. Klein argues that making policy moves now to increase investment in renewable energy makes economic sense, while oil prices are at very low levels, and likely to remain low for the longer term.

UBC Faculty Joins Other Prestigious Universities Calling for Fossil Fuel Divestment

The University of British Columbia is following the lead of faculty and students at Harvard University, the University of California, Stanford University and many other universities across North America.  Also of note, Norway’s sovereign investment fund, the largest in the World @ $1.3 Trillion, has already made the decision to divest. The current fossil fuel market collapse and likely long term instability is prima facie evidence of the need for divestment, and to prevent further increases in carbon emissions.

UBC Faculty Open Letter Here: UBC Faculty Call For Fossil Fuel Divestment

This Big Idea is sweeping public and private institutional investment funds globally in the belief that it is overdue to begin more demonstrative action against human caused climate change.  Canadians have a particularly important role to play in this.  Current government policy has focused the economy on fossil fuels, at the expense of a broader based economy, and is now experiencing the wrath of the “natural resource curse. Canadian innovation and productivity have plummeted on the OECD scale, and Canada is entering a highly volatile and uncertain recessionary period, as forecast by The Conference Board of Canada, the International Monetary Fund, and numerous Canadian banks.

From the Canadian Broadcasting Corporation:

Faculty at the University of British Columbia have voted in favour of the institution divesting its existing fossil fuel holdings and forgoing further investments in companies connected with fossil fuels.

“Students have spoken. Faculty have spoken. It’s time for UBC to act,” George Hoberg, professor in forest resources management, said in a statement. “Climate change presents an urgent crisis for humanity.”

The results of the referendum were released Tuesday, with 62 per cent of voters supporting divestment.

A fossil-free portfolio

Of UBC’s $1.2-billion endowment fund, more than $100 million is invested in oil, natural gas and coal. The faculty vote is calling on the university to divest completely from those holdings within five years.

“Just as UBC has pledged to use its campus as a ‘living laboratory’ for sustainability, we call on our university to apply its expertise with the same vigour to the endowment,” said Kathryn Harrison, professor of political science and a climate policy expert.

“UBC should devise a profitable, fossil-free portfolio that can serve as an inspiration for sustainable investing by other institutions.”

The faculty will now put their proposal to the university’s board of governors.

“UBC is a place of academic dialogue and debate, and we welcome our faculty members’ interest in our investment policies,” the university said in a statement responding to today’s result. “As the trustee of the endowment, UBC has a fiduciary obligation to ensure that it is managed prudently.”

A growing movement

The fossil fuel divestment movement started in the United States and has spread across North America and Canada.

Last year, UBC students held their own referendum on the issue, with an almost four-to-one vote in favour of divestment.

Today’s vote comes just before Global Divestment Day on Friday when, the UBC campaigners say, a divestment campaign will be launched at the University of Calgary.

Preparing For The Long Term Consequences In Texas And Western Canada

UPDATE: January 20, 2015. Target announced this week that it will be closing all 133 stores in Canada, including the Vernon and Kelowna stores. eliminating at least a couple of hundred local $10/hr jobs and a handful of slightly better paid management jobs. The Wall Street Journal is reporting that Target’s 17,000 + Canadian layoffs of low income workers will be the largest in Canadian history.

OPEC Report Downgrades Demand for Its Oil as Prices Fall Again

The growing downturn in the fossil fuels industry has extraordinary implications globally.  While some are proposing theories that this downturn will be short-lived, there simply isn’t much evidence to support an optimistic forecast.  Saudi Arabia is openly executing a long term strategy to squeeze “high cost oil producers,” using its unquestioned leverage and the lowest production costs in the World.  Europe is facing potential deflation, and the current European recession is forcing the European Central Bank to begin “quantitative easing,” beginning this week, essentially printing money.  The Russian economy is in shambles as the ruble weakens, something Putin did not plan on occurring.  The Chinese economy has weakened sharply and will likely remain weak into the near foreseeable future. Meanwhile Canada is at the mercy of these global forces, with little in the way of economic reserves to defend its economy, having bet the entire Canadian economy on oil. Somehow Joe Oliver promised he would balance the Canadian budget in 2015, and then the next day, Oliver ate crow, and walked back his promise.  In a surprise move, The Bank of Canada then reduced the lending rate to 0.75%, causing the loonie to plummet below 81 cents. Things are not what the government wants us to believe.

There are significant hedge bets in the market that oil will soon return to $100 per barrel. A prominent optimistic theory suggests that Saudi Arabia and the United States are collaborating to squeeze Putin and the Russian oil economy, and oil will bounce back within 90 days. However, most economists and oil industry analysts are projecting a much longer and deeper petroleum industry recession than in the 1980’s, for example.  The predominant view is that it will persist for at least five years or longer.

In Texas, Hunkering Down for the Oil Bust

Reblogged from The New York Times

By CLIFFORD KRAUSSJAN. 19, 2015

MIDLAND, Tex. — With oil prices plummetingby more than 50 percent since June, the gleeful mood of recent years has turned glum here in West Texas as the frenzy of shale oil drilling has come to a screeching halt.

Every day, oil companies are decommissioning rigs and announcing layoffs. Small firms that lease equipment have fallen behind in their payments.

In response, businesses and workers are getting ready for the worst. A Mexican restaurant has started a Sunday brunch to expand its revenues beyond dinner. A Mercedes dealer, anticipating reduced demand, is prepared to emphasize repairs and sales of used cars. And people are cutting back at home, rethinking their vacation plans and cutting the hours of their housemaids and gardeners.

Dexter Allred, the general manager of a local oil field service company, began farming alfalfa hay on the side some years ago in the event that oil prices declined and work dried up. He was taking a cue from his grandfather, Homer Alf Swinson, an oil field mechanic, who opened a coin-operated carwash in 1968 — just in case.

Photo

Homer Alf Swinson, left, an oil field mechanic, opened a coin-operated carwash in 1968 — just in case oil prices declined. CreditMichael Stravato for The New York Times

“We all have backup plans,” Mr. Allred said with laugh. “You can be sure oil will go up and down, the only question is when.”

Indeed, to residents here in the heart of the oil patch, booms and busts go with the territory.

“This is Midland and it’s just a way of life,” said David Cristiani, owner of a downtown jewelry store, who keeps a graph charting oil prices since the late 1990s on his desk to remind him that the good times don’t last forever. “We are always prepared for slowdowns. We just hunker down. They wrote off the Permian Basin in 1984, but the oil will always be here.”

It’s at times like these that Midland residents recall the wild swings of the 1980s, a decade that began with parties where people drank Dom Pérignon out of their cowboy boots. Rolls-Royce opened a dealership, and the local airport had trouble finding space to park all the private jets. By the end of the decade, the Rolls-Royce dealership was shut and replaced by a tortilla factory, and three banks had failed.

There has been nothing like that kind of excess over the past five years, despite the frenzy of drilling across the Permian Basin, the granddaddy of American oil fields. Set in a forsaken desert where tumbleweed drifts through long-forgotten towns, the region has undergone a renaissance in the last four years, with horizontal drilling and fracking reaching through multiple layers of shales stacked one over the other like a birthday cake.

But since the Permian Basin rig count peaked at around 570 last September, it has fallen to below 490 and local oil executives say the count will probably go down to as low as 300 by April unless prices rebound. The last time the rig count declined as rapidly was in late 2008 and early 2009, when the price of oil fell from over $140 to under $40 a barrel because of the financial crisis.

Unlike traditional oil wells, which cannot be turned on and off so easily, shale production can be cut back quickly, and so the field’s output should slow considerably by the end of the year.

The Dallas Federal Reserve recently estimated that the falling oil prices and other factors will reduce job growth in Texas overall from 3.6 percent in 2014 to as low as 2 percent this year, or a reduction of about 149,000 in jobs created.

Midland’s recent good fortune is plain to see. The city has grown in population from 108,000 in 2010 to 140,000 today, and there has been an explosion of hotel and apartment construction. Companies like Chevron and Occidental are building new local headquarters. Real estate values have roughly doubled over the past five years, according to Mayor Jerry Morales.

The city has built a new fire station and recruited new police officers with the infusion of new tax receipts, which increased by 19 percent from 2013 to 2014 alone. A new $14 million court building is scheduled to break ground next month. But the city has also put away $39 million in a rainy-day fund for the inevitable oil bust.

“This is just a cooling-off period,” Mayor Morales said. “We will prevail again.”

Expensive restaurants are still full and traffic around the city can be brutal. Still, everyone seems to sense that the pain is coming, and they are preparing for it.

Randy Perry, who makes $115,000 a year, plus bonuses, managing the rig crews at Elevation Resources, said he always has a backup plan.

“We are responding to survive, so that we may once again thrive when we come out the other side,” said Steven H. Pruett, president and chief executive of Elevation Resources, a Midland-based oil exploration and production company. “Six months ago there was a swagger in Midland and now that swagger is gone.”

Mr. Pruett’s company had six rigs running in early December but now has only three. It will go down to one by the end of the month, even though he must continue to pay a service company for two of the rigs because of a long-term contract.

The other day Mr. Pruett drove to a rig outside of Odessa he feels compelled to park to save cash, and he expressed concern that as many as 50 service workers could eventually lose their jobs.

But the workers themselves seemed stoic about their fortunes, if not upbeat.

“It’s always in the back of your mind — being laid off and not having the security of a regular job,” said Randy Perry, a tool-pusher who makes $115,000 a year, plus bonuses, managing the rig crews. But Mr. Perry said he always has a backup plan because layoffs are so common; even inevitable.

Since graduating from high school a decade ago, he has bought several houses in East Texas and fixed them up, doing the plumbing and electrical work himself. At age 29 with a wife and three children, he currently has three houses, and if he is let go, he says he could sell one for a profit he estimates at $50,000 to $100,000.

Just a few weeks ago, he and other employees received a note from Trent Latshaw, the head of his company, Latshaw Drilling, saying that layoffs may be necessary this year.

“The people of the older generation tell the young guys to save and invest the money you make and have cash flow just in case,” Mr. Perry said during a work break. “I feel like everything is going to be O.K. This is not going to last forever.”

The most nervous people in Midland seem to be the oil executives who say busts may be inevitable, but how long they last is anybody’s guess.

Over a lavish buffet lunch recently at the Petroleum Club of Midland, the talk was woeful and full of conspiracy theories about how the Saudis were refusing to cut supplies to vanquish the surging American oil industry.

“At $45 a barrel, it shuts down nearly every project,” Steve J. McCoy, Latshaw Drilling’s director of business development, told Mr. Pruett and his guests. “The Saudis understand and they are killing us.”

Mr. Pruett nodded in agreement, adding, “They are trash-talking the price of oil down.”

“Everyone has been saying `Happy New Year,’” Mr. Pruett continued. “Yeah, some happy new year.”