Are deep neural networks dramatically overfitted?

Geek alert (headline = link btw). That is an excellent piece on overfitting effects in what many people refer to as ‘AI’ (Artificial Intelligence) or ‘ML’ (Machine Learning).

Overfitting: the nature of the models widely used, in detail some methods like backpropagation, amplifies multicollinearity within these models, which basically means to artificially create stronger correlations between independent variables and the dependent variable in a development sample. That can lead to extraordinary predictive accuracy of the model – which is limited to the test sample, while it performs much worse using e.g. real-life data. The model then has been ‘over-fitted’ to that particular data sample.

Despite (European) startups claiming to use ‘AI’ in many cases but just don’t do that, always remember as a rule of thumb if someone talks to you about ‘AI’:

In your pitch, it’s AI.
In your specs, it’s ML.
In your pilot, it’s linear regression.
In your product, it’s printf();

Don’t know the source (thanks for any hint!), I recently read it on LinkedIn and had a good laugh 🙂

More

FutureID3: Biometrics & automated decision making

Picture courtesy of Mia Harbitz

It has been a pleasure to be part of FutureID3 at Jesus & St. John’s Colleges at Cambridge as a speaker, thanks for having me.

Part of the journey were many interesting and meaningful insights into biometrics in ID registration, automated decision making, its applications in the field, policy making, but also its societal effects, and challenges. Highly recommended to anyone who engages in that area.

My part was about the relevance of social acceptance of variables in credit scoring, and their actual predictive power when calculating a credit score. An appendix to that was about how we apply some of the resulting principles at awamo in East Africa.

Overall a very interesting event, with lots of insights from recent research, and the actual field applications, with lots of inspiring participants from all over the world. Special thanks go Keith Breckenridge from University of Witwatersrand (South Africa) for organizing the event, and to Simon Szreter for giving us the grand tour on Jesus & St. John’s Colleges.

More

Hand-picked software for work & office

Photo by Christopher Gower on Unsplash

I’ve been building my personal Windows-toolchain for more than 20 years, and that is why people approach me frequently to ask for tools for this and tools for that. Find here my toolchain, which should make things easier for everyone.

In general, I will prefer open source or freeware tools, unless a commercial solution is clearly superior in my eyes. For most of my recommendations, there are also versions for Mac, and Linux.

(more…)

More

Founder paperwork

This may happen to your personal document stash if you decide to start a company .
Unless you’re following some super-duper “get your shit done with this morning ritual and habits”.
BUT: it’s strictly chronological 2016-2017;)

More
Do NOT follow this link or you will be banned from the site!