6 Things AI and Machine Learning Reshape in SW


In my recent post, I mentioned that AI and ML challenge architecture, but also offer tools to tackle the challenges. Needless to say, automation of repetitive tasks will change our job descriptions, just like those of our end users.

The SW development lifecycle is changing too. Architects with experience from an environment with external content prosumers or open-source developers, will find some lifecycle changes similar to those two environments.

1. Crowd management
Much of the “crowd” involved is outside the IT organization (e.g. experts in domains other than IT), or even outside the enterprise - not least in Data as a Service offering ML from data sources such as digital twins (of customer-owned equipment, e.g. railroads and trains at Siemens, networks at Ericsson, or farming machinery at John Deere). Architects or CIOs have influence rather than full control, unlike in internal projects.

2. Crowdsourcing
Both the data and some ML-generated logic come from external sources, not least when some ML and computing runs locally on “edge” devices that produce the input data.

3. Adaptive planning
Distinct project phases tend to disappear, partly because of the “crowd” out there, partly because of the explorative nature of ML (“think more like a researcher, less like a programmer”). For example, a partial result of an ML project can hint about additional key domains to drill into, thus widening the scope and postponing the deadline.

4. Incomplete requirements
Customers may have a rather sketchy idea of what they want. “More bang for the buck” wouldn’t hint on “increased harvest, better soils, 80 percent less herbicides due to spraying individual weed plants only”, but ML with fast pattern recognition (in RT field images) does exactly that.

5. Widened job roles
Apart from the SW (development) lifecycle and the nature of new apps, AI reshapes the way they’re developed and thus our roles too. Architects and some devs become even curators of training data sets, co-analysts of ML results, and a guide for experts from non-IT domains, to enable them to apply ML in their specific tasks.

6. A hard core (platform)
The core (e.g. an automated data/ML platform) has to be secure, robust, modular, reliable (fault-tolerant, even on external error), documented and teachable to teams within the enterprise. The ML-generated system has to interoperate with other, programmer-made, systems (pre-ML AI, and other SW). The ML-generated logic has to be auditable and verifiable; indeed, explainability is the door to acceptance in mission-critical apps.
















Figure from course AI, Architecture, and Machine Learning (T1913)

Trainer at Informator, senior modeling and architecture consultant at Kiseldalen.com, main author : UML Extra Light (Cambridge University Press) and Growing Modular (Springer), Advanced UML2 Professional (OCUP cert level 3/3).

  


Milan and Informator collaborate since 1996 on architecture, modelling, UML, requirements, rules, and design. You can meet him this Spring at public courses (
in English or Swedish) on AI, Architecture, and Machine Learning  (T1913),  Architecture (T1101, T1430) or Modeling  (T2715, T2716).

Yet another AI language you miss in your CV? 4 reasons why it will matter less and less.


It never hurts, but it varies how helpful a (fairly) new programming or script language is. From more or less a prerequisite in R&D and platform-vendor firms, to a nice-to-have CV footnote in mainstream businesses that rather emphasize extended SQL, analytics , data architecture, and automated ML platform/s.

Here are 4 reasonswhy you can live with it (ascending order by weight)

1. The fate of LISP, Prolog, Smalltalk, KQLM etc. (use comment form below to fill in what’s missing : ))
To drive the history of applied “AI 1.0” to the extremes, an enterprise in the 1980-ies was expected to achieve superpowers as soon as the CIO (and preferably, CEO : )) learned at least one exotic-enough AI language. The subsequent AI winter after 1990 happened supposedly because most CIO’s refused to so; best case: they got lost somewhere inside their fifth pair of nested parentheses in LISP (like most of us devs did too, including myself)…

2.
The rise of expert-system development shells in business (near 1990)
Programming languages are versatile. You can get anything you need, given a generous timeframe. Development tools encapsulate a lot of technical detail. You can get more or less what you need, even under tight time constraints. No wonder it’s more appealing to CIOs than nested parentheses.

3. Success of those who used then-mainstream industry languages
 
Books on configurators, or on LISP, drill down into Digital (HP) XCON/R1, but in books on management and modular manufacturing, you read about Scania Trucks & Buses (reporting profits for 80 consecutive years). Scania’s smart proprietary configurator (an age fellow of XCON) became a backbone of the enterprise, and grew to several times the size of XCON. Unlike XCON, Scania did cope in maintenance and upgrades. For decades. Offering complex customized vehicles assembled from a cluster of common component types. Language: unglamorous then-mainstream Cobol and DL/1.

4. A trend toward frameworks, component libraries, automated analytics & ML platforms
It’s a two-way street. On one hand, “AI 2.0” and ML challenge current architectures, not least data architectures: big-data ingestion, parallelism, fast access aid for non-sequential access because learning (in both human and artificial neural networks) is essentially non-sequential (parallel).
On the other hand, ML offers a toolbox to tackle these challenges, and also, enables quite some automation of the entire data pipeline and of an architect’s (or dev’s) repetitive tasks. I won’t be surprised if automated-ML platforms for big data, using extended SQL instead of script languages, spark success stories of Scania’s magnitude. It’s about the augmentation (or automation) itself, and about architecture fit for business, rather than about the detail.
So from now on, Informator’s new one-day course is called AI, Architecture, and Machine Learning. Neither just AI for Architecture, nor just Architecture for AI. It’s a two-way street.

Rapid progress in the middle
Figure from course AI, Architecture, and Machine Learning (T1913)

Trainer at Informator, senior modeling and architecture consultant at Kiseldalen.com, main author : UML Extra Light (Cambridge University Press) and Growing Modular (Springer), Advanced UML2 Professional (OCUP cert level 3/3).

Milan and Informator collaborate since 1996 on architecture, modelling, UML, requirements, rules, and design. You can meet him this Spring at public Architecture courses in English or Swedish (T1913, T1101, T1430) or Modeling courses ( T2715, T2716)
     


5 ”inte” som gjort AI 2.0 het

I mars gjorde tillämpad AI stora rubriker igen. Den här gången var det machine learning (ML) med neurala nät i poker, Deep Stack. Vad är det som gör detta senaste framsteg intressant bland forskare, arkitekter och företag som provar big data och ML? Det går att sammanfatta i 5 stycken ”inte”:

1. Deep Stack kräver inte en superdator, utan klarar sig med laptop och ett Nvidia grafikkort som en vanlig tonårsgamer skulle räkna som rätt normalt.

2. Michael Bowlings forskarteam är inte från Oxford, Cambridge, eller ett amerikanskt universitet, utan från Edmonton och Prag.

3. Segermarginalen mot mänskliga motspelare var inte liten, snarare förkrossande. 11 pokerproffs slutförde hela turneringen mot Deep Stack, vardera 3000 spelomgångar. Alla förlorade.

4. Inslag av trädbeskärning med heuristisk sökning och sparse lookahead: de artificiella neurala näten (ANN) i Deep Stack söker inte igenom hela sökrymden av möjliga spelsituationer (ett astronomiskt tal, med 170 nollor), utan iterativt från aktuellt läge ner till en limit (depth bound), där ett beräknat värde hintar om hur mycket det brukar vara värt att fortsätta spela vidare på just den grenen i sökträdet, och värdet baseras på miljontals spelsituationer som samma ANN fått lösa under träningsfasen (dvs ett estimat utifrån nätets erfarenhet eller inlärda ”intuition”). Kombinationen gav run-time svarstider på bara 3 sekunder i snitt.

5. Pokerspelet utgår hela tiden från information som inte är fullständig (om motspelarens kort och spelet i övrigt). Det gör Deep Stack till ett genombrott i en gren av AI som hittills hållit sig till spel med fullständig information: schack, Go, Dam, mm där spelarna ser samma spelbräda. Bowling och hans team har därmed banat vägen för applikationer på en rad områden där ofullständig information om motparten är det vanliga: internetsäkerhet, ekonomi och förhandlingar, auktioner och budgivning, försäljning och kontrakt, försvar och spaning, bedrägeriprevention, oanmälda kontroller, diplomati, m m. Som svenska IDG:s CFO World beskrev ML i oktober: att ”automatiskt” göra ­organisationen smartare.


I vintras hamnade AI-poker i rampljuset med Libratus på superdator, utvecklad vid Carnegie Mellon University i Pittsburgh (Sandholm & Brown). Är man konspiratoriskt lagd börjar man undra över gåtfulla big-data samband mellan AI och hockeystäder. Ordet/kommentarfältet är fritt. Edmonton, Prag, Pittsburgh, även Helsingfors och en av Finlands mest citerade forskare, Teuvo Kohonen – inte direkt poker, men googla gärna Dimesionality Reduction eller Self Organizing Maps.


(Källa: Wikimedia)



Lärare på Informator, modellerings- och arkitekturkonsult på Kiseldalen.com, 
huvudförfattare: UML Extra Light (Cambridge University Press) och Growing Modular (Springer).

Advanced UML2 Professional (OCUP cert-nivå 3 av 3). Milan samarbetar med Informator sedan 1996 inom Arkitektur ( T1101 , T1430) och Modellering (T2715, T2716).