TL;DR In Southern California should put PV on houses and buildings that are far from the coast, because coastal areas are cloudy much of the summer. But the actual pattern is the opposite. I estimate a 30% magnitude of loss. Even my employer, UCSD, has engaged in this foolishness in order to appear trendy.
Should data mining newcomers have to learn programming at the same time? Here is a contrarian view, which advocates a GUI (“drag and drop”) environment. Even though the popularity of R (and recently, Python) is increasing.
I have just finished my Big Data course for 2017, and noted some concepts that I want to teach better next year. One of them is how to interpret and use the coefficient estimates from linear regression. All economists are familiar with dense tables of coefficients and standard errors, but they require experience to read, and are not at all intuitive. Here is a more intuitive and useful way to display the same information. The blue dots show the coefficient estimates, while the lines show +/- 2 standard errors on the coefficients. It’s easy to see that the first two coefficients are “statistically significant at the 5% level”, the third one is not, and so on. More important, the figure gives a clear view
of the relative importance of different variables in determining the final outcomes.
The heavy lifting for this plot is done by the function sjp.lm from the sjPlot library. The main argument linreg is the standard results of a linear regression model, which is a complex list with all kinds of information buried in it. Continue reading
Melinda Gates and Fei-Fei Li Want to Liberate AI from “Guys With Hoodies”
Who designs software makes a big difference. And Silicon Valley employees are not a cross-section of anything, except each other. Nor need they be; but some balance is needed to make sure products are designed to help diverse people.
As a technologist, I see how AI and the fourth industrial revolution will impact every aspect of people’s lives. If you look at what AI is doing at amazing tech companies like Microsoft, Google, and other companies, it’s increasingly exciting.
But in the meantime, as an educator, as a woman, as a woman of color, as a mother, I’m increasingly worried. AI is about to make the biggest changes to humanity and we’re missing a whole generation of diverse technologists and leaders. Source.
For one reason this problem is growing right now, see the next story: oligopoly control of AI applications in our lives.
Another case of the “Big 5” grabbing new AI-related technology before it becomes public.
The strength of this pattern, where the Big 5 (Apple, Amazon, Google, Microsoft, Facebook) buy out each novel tech idea and hide it in-house, as anti-competitive and bad for society as a whole. Apple, because of its level of secrecy, may be worse than some of the others. In a competitive world such purchases would not be a big problem – let the market figure it out. But with the huge cash levels of these companies, which itself indicates monopoly power, they can effectively stifle new ideas that might threaten them in the long run.
Amazon’s new age grocery likely wasn’t technically possible even five years ago.
AI, machine learning, etc only appear to be objective. In reality, they reflect the world view and prejudices of their developers.
Algorithms have been empowered to make decisions and take actions for the sake of efficiency and speed…. the aura of objectivity and infallibility cultures tend to ascribe to them. . the shortcomings of algorithmic decisionmaking, identifies key themes around the problem of algorithmic errors and bias, and examines some approaches for combating these problems. This report highlights the added risks and complexities inherent in the use of algorithmic … decisionmaking in public policy. The report ends with a survey of approaches for combating these problems.
This is relevant to GPS students who are considering where they will fit in the data analytics/big data world.
Interview of Emily Robinson, who transitioned from a social science background to a career in data science, recently becoming a data analyst at Etsy.
TL;DR It will take 5+ years for standards to get sorted out in home automation. Until they are, devices from different companies will not be compatible. Anything that you buy and install now will be inconvenient (you will need multiple interfaces) and become obsolete in a few years.
Now that there are many genuinely useful and modestly priced home automation devices (and I don’t mean smart refrigerators), we are ready to enter the rising portion of “the S curve” where penetration increases. Most of the devices can be retrofit, which will make uptake much easier.
But right now, most vendors have their own protocols. Common protocols are needed at 3 layers: the user interface, such as a mobile phone/computer app (or web site), physical communication such as Bluetooth, Zigbee, or Wi-Fi, and data protocols (API’s, essentially). Most vendors appear to be moving toward a hub and spokes arrangement, where the hub handles communication to the user and outside the home, so there will also be competition for whose hub customers buy. Finally, I would add security as its own “layer,” since it is so important and currently completely neglected.