====== [hemmerling] Data Processing 5/8 - Business Intelligence, Data Mining ======
Related pages:
  *[[databases.html|Data Processing 1/8 - Databases, Webserver, Webservices, SQL, XML]].
  *[[databases02.html|Data Processing 2/8 - Descriptions of Data, Data Transfer and Data Protocols]].
  *[[nosql.html|Data Processing 3/8 - NoSQL Databases: Not Just SQL]].
  *[[dbadmin.html|Data Processing 4/8 - Database Managment Tools and Database Application Development Tools]].
  *[[datawarehouse.html|Data Processing 6/8 - Data Warehouse Modeling]].
  *[[mlearning.html|Data Processing 7/8 - Machine Learning]].
  *[[ai.html|Data Processing 8/8 - Artificial Intelligence ( AI )]].
  *[[fiware.html|FIWARE 1/2]].
  *[[infographics.html|Data Visualisation with Infographics]].
  *[[microsoft.html|Microsoft & Microsoft Partners & Third Party Services]].
  *[[mathengineering.html|Mathematical Engineering]].
  *[[opendata.html|Open Data]].
===== Organizations =====
  *[[http://www.datascienceassn.org/|Data Science Association]].
  *[[http://www.dgiq.de/|Deutsche Gesellschaft für Informations- und Datenqualität e.V. (DGIQ)]].
  *[[http://www.die-ding.de/|DING e.V. - Deutschsprachige Informatica Nutzer Gruppe]] ( formerly: "Deutschsprachige Informatica Nutzergruppe" ).
  *[[http://www.tdwi.org/|The Data Warehouse Institute ( TDWI )]] US, [[http://www.tdwi.eu/|The Data Warehouse Institute ( TDWI )]] Europe / Germany.
    *The paper magazine [[http://www.bi-spektrum.de/|BI Spektrum - Fachzeitschrift für Business Intelligence und Data Warehousing. Eine Publikation des TDWI Germany e.V.]].
  *[[http://www.vtad.de/|Vereinigung Technischer Analysten Deutschlands e.V. ( VTAD )]].
    *Book [[http://www.amazon.de/exec/obidos/ASIN/0814408648/hemmerling-21|Robert D. Edwards, John Magee, W. H. C. Bassetti: "Technical Analysis of Stock Trends"]].
    *Book [[http://www.amazon.de/exec/obidos/ASIN/0071381937/hemmerling-21|Martin J. Pring: "Technical Analysis Explained. The Successful Investor's Guide to Spotting Investment Trends and Turning Points"]].
  *[[http://www.meetup.com/SAP-Stammtisch-Hannover/|Meetup "SAP Stammtisch Hannover"]].
  *[[http://www.meetup.com/power-bi-user-group-hamburg/|Meetup "Power BI User Group Hamburg"]].
===== Conferences, Seminars, Trainings =====
==== Germany ====
  -[[http://www.datamodelingzone.eu/|Data Modeling Zone]] in Hannover ( 2013-09-23 - 2013-09-24 ).
  -[[http://www,icaml.org/|Interdisciplinary Center for Applied Machine Learning]].
    *[[http://www.ikg.uni-hannover.de/forschung_ikg.html|Leibniz Universität Hannover, Institut für Kartographie und Geoinformatik "Research"]].
      *[[http://www.ikg.uni-hannover.de/bigdata_machinelearning.html|Leibniz Universität Hannover, Institut für Kartographie und Geoinformatik "Big Data and Machine Learning"]].
        *[[http://www.ikg.uni-hannover.de/forschung_details.html|Leibniz Universität Hannover, Institut für Kartographie und Geoinformatik "Interdisciplinary Center for Applied Machine Learning - ICAML"]].
    *[[http://www,icaml.org/events.html|Interdisciplinary Center for Applied Machine Learning "Events"]].
  -[[http://www.tdwi.eu/|The Data Warehouse Institute ( TDWI )]].
    *[[http://www.tdwi.eu/veranstaltungen/roundtable.html|The Data Warehouse Institute ( TDWI )]] Roundtable.
      *[[http://www.tdwi.eu/startseite/veranstaltungen/roundtable/hannover.html|TDWI Roundtable "Hannover"]].
      *[[http://www.tdwi.eu/startseite/veranstaltungen/roundtable/hamburg.html|TDWI Roundtable "Hamburg"]].
    *[[http://www.tdwi-konferenz.de/|TDWI Konferenz]], München.
      *2016.
        *[[http://www.tdwi-konferenz.de/tdwi2016.html|TDWI Konferenz 2016]] - I joined 2016-06-21 the Seminar "Self-Service Analytics mit Qlik" ( "Self-Service Analytics with Qlik" ) by [[http://www.digital-ratio.de/|Digital Ratio GmbH]].
        *[[http://www.digital-ratio.de/events/7-theme-self-service-bi-mit-qlik-tdwi-konferenz-2016/|Digital Ratio GmbH "TDWI-Konferenz 2016: Self-Service Analytics mit QlikDigital Ratio GmbH"]], 2016-06-21.
        *[[http://www.digital-ratio.de/events/tdwi-2016-digitale-transformation/|Digital Ratio GmbH "TDWI-Konferenz 2016: Digitale Transformation der BI"]], 2016-06-22.
      *2018.
        *[[http://www.tdwi-konferenz.de/tdwi2018.html|TDWI Konferenz 2018]] - I joined the full conference, with a sponsored ticket :-).
      *2020.
        *The online conference [[http://www.tdwi.eu/veranstaltungen/konferenzen/tdwi-schweiz|TDWI Virtual]], 2020-06-23 - 2023-06-24 - "Die TDWI Virtual ist die kostenfreie Online-Konferenz für Data, BI und Analytics".
        *[[http://www.youtube.com/watch?v=AchRqTqIzss|YouTube "TDWI Virtual | 23. + 24. Juni 2020"]].
      *2021.
        *The online conference [[http://www.tdwi-konferenz.de/tdwi-2021.html|TDWI München 2021]], 2021-06-21 - 2021-06-23 - I joined the free seminars of the conference. 
      *2022.
        *The conference with free tracks [[http://www.tdwi-konferenz.de/tdwi-2022.html|TDWI München 2022]].
        *[[http://www.tdwi.eu/order/conf/tdwi2022/workshops/index.php?locale=DE|TDWI "Registrierung für das freie Programm der TDWI München 2022"]].
      *Conference app.
        *[[http://sigs-datacom.plazz.net/|Website ""SIGS DATACOM IT EventApp"]].
        *[[http://play.google.com/store/apps/details?id=net.plazz.mea.sigs|Google Play "SIGS DATACOM IT EventApp"]], 2018.
        *username: Your E-Mail, initial password: "tdwi2018".
  -[[http://www.microstrategy.com/us/resources/symposium-series|MicroStrategy Symposium Series]].
    *[[http://events.microstrategy.com/Symposium-Munich|MicroStrategy Symposium - Munich]] in München, 2018-10-18.
  -TDWI Young Guns.
    *[[http://www.linkedin.com/showcase/tdwi-young-guns|LinkedIn "TDWI Young Guns"]].
    *[[http://www.xing.com/communities/groups/tdwi-young-guns-1089910|XING "TDWI Young Guns"]]
    *[[http://www.twitter.com/TDWI_EU|Twitter "TDWI EU"]].
    *[[http://tdwi-young-guns.slack.com/|Slack "TDWI Young Guns"]].
    *Events.
      *The free online barcamp [[http://www.tdwi.eu/veranstaltungen/events-powered-by-young-guns/aktuelle-termine.html|TDWI "Oops - we do it again - Data & Analytics BarCamp Vol. 4"]], 2021-09-16.
        *[[http://app.sli.do/event/nlrvvdcr|Sli.Do "Oops - we do it again - Data & Analytics BarCamp Vol. 4"]].
        *Traveling Salesman.
          *[[http://miro.com/app/board/o9J_lw8T-5s=/|Miro Board "Oops - we do it again - Data & Analytics BarCamp Vol. 4"]].
          *[[http://www.github.com/arnimpdm/Get_in_IT_Travelling_Salesman_Problem|GitHub "arnimpdm / Get_in_IT_Travelling_Salesman_Problem"]].
          *[[http://www.icon-map.com/usage_circles.html|Icon Map]].
          *[[http://www.observablehq.com/@d3/gallery|Observable "@D3 / Gallery"]].
        *[[http://www.oikosofyseries.com/how-to-succeed-with-agile-bi-the-book-page|OikoSoft "How to succeed with your Agile BI project"]].
      *The free online barcamp [[http://www.tdwi.eu/veranstaltungen/events-powered-by-young-guns/aktuelle-termine|TDWI "Irren ist menschlich – Mach ‘was draus Vol. 2 | Data & Analytics F*ckUp Night"]], 2022-02-10, 18:00.
  -[[http://www.powerthon.info/|Deutschland Powerthon - Das erste vollständig klimaneutrale Microsoft Community Event]].
    *2021.
    *2022.
      *[[http://www.duesiblog.de/2022/02/global-power-platform-bootcamp-2022/|Düsiblog - Matthias Düsi "Global Power Platform Bootcamp 2022"]].
    *2023-02-24 - 2023-02-25.
      *"Global Power Platform Bootcamp 2023" - "Am 24./25. Februar findet das weltweite Global Power Platform Bootcamp 2023 statt".
        *Power Platform User Group Hannover.
          *[[http://www.powerthon.info/event/global-power-platfrom-bootcamp-hannover/|Deutschland Powerthon "Global Power Platfrom Bootcamp Hannover"]], 2023-02-24.
        *Power Platform User Group Hamburg.
  -[[http://www.de/|DatenPioniere GmbH]].
    *[[http://www.datenpioniere.de/events|DatenPioniere GmbH "Events"]].
      -Full-day online training [[http://www.datenpioniere.de/ms-power-bi-schulung|DatenPioniere GmbH "Microsoft Power BI Training - Wir machen Euch fit"]], 2023-02-03, 2023-03-03, 08:30-16:30. I joined :-).
        *"Kostenfreie Anmeldung. Werde mit uns zum Power BI Champion und melde Dich heute noch zur kostenfreien Basis Schulung an".
        *"Jeden Monat bietet Dir Niklas ein kostenfreies Tagestraining an. Wir sind davon überzeugt, dass mehr gute Entscheidungen in deinem Unternehmen getroffen werden, wenn mehr Mitarbeitende Power BI beherrschen. Melde dich heute noch an".
        *Certificate [[http://www.virtualbadge.io/certificate-validator?credential=cer-abe6c8bf-a994-4599-8569-601bff67|VirtualBadge "Power BI Champion Kurs by DatenPioniere GmbH - Rolf Hemmerling"]], 2023-02-03.
        *[[http://datenpioniere-my.sharepoint.com/personal/niklas_thoms_datenpioniere_de/_layouts/15/onedrive.aspx?id=%2Fpersonal%2Fniklas%5Fthoms%5Fdatenpioniere%5Fde%2FDocuments%2FDesktop%2FSchulungen%2FPower%20BI%20Champion%2003%2E02%2E2023|OneDrive "Microsoft Power BI Training - Wir machen Euch fit"]].
        *[[http://www.ph.ucla.edu/epi/snow/snowbook.html|UCLA "On the Mode of Communication of Cholera by John Snow, M.D."]].
        *As of 2023-01:
          *Power BI Pro doesn't provide machine learning / artificial intelligence functions :-(.
          *Power BI Premium provides machine learning / artificial intelligence functions :-).
        *Starscheme: Separation of fact table and dimension table.
          *Fact table ( FACT_xxx, F_xxx ): German w-questions ( who, what, when, amount, rebate.. ), what is relevant for a financial transaction ( buy / sell / contract ).
          *Dimension table ( DIM_xxx, D_xxx ): Product ID, product category, country of customer.
          *If a customer buys 1000x the same good, you don't want all the 1000 data items in the dimension table.
        *Spreadsheet Cell vs. Calculated column vs. Measure.
          *[[http://learn.microsoft.com/de-de/dax/dax-function-reference|Microsoft Learn "DAX-Funktionsreferenz"]].
          *In opposite to spreadsheets, BI tools are not based on the "cell" principle :-(, you can just address columns, not single cells :-(.
          *Calculated columns require filespace, Measures don't require filespace, as they are calculated in-memory.
          *Calculations<code>
Umsatz = 'F_Order Details'[Unit Price] * 'F_Order Details'[Quantity] *(1-'F_Order Details'[Discount])
Einkaufskosten = 'F_Order Details'[Quantity] * RELATED(D_Products[UnitCost])
Gewinn = 'F_Order Details'[Umsatz] - 'F_Order Details'[Einkaufskosten]

Datumstabelle =
VAR ErsteErfassung = Min(F_Orders[Order Date])
VAR Kalender = CALENDAR(Date(Year(ErsteErfassung),1,1), Date(Year(Now())+1,12,31))
return
ADDCOLUMNS( Kalender,  
"Jahr", Year([Date]),
"JahrQuartal", FORMAT([Date], "yyyy-Q"),
"JahrMonat", FORMAT([Date],"yyyy-mm"),
"JahrKW", COMBINEVALUES("-", Year([Date]), FORMAT(WEEKNUM([Date],21),"00")),
"Quartal", FORMAT([Date], "\QQ"),
"Kalenderwoche", WEEKNUM([Date], 21),
"Monat", FORMAT([Date], "mmm"),
"Monat#", Month([Date]),
"Wochentag", FORMAT([Date], "ddd"),
"Wochentag#", Weekday([Date], 2)
)
</code>
      *Important settings:
        *"File / Options and settings / Options" - "Global / Data Load".
          *"[_] Time intelligence".
        *"File / Options and settings / Options" - "Current File / Data Load".
          *"[_] Time intelligence".
          *"[_] Import relationships from data soruces on first load".
          *"[_] Autodetect new relationships after data is loaded".
      *Drilldown fields "Category Name, County aus Customers, Last Name aus Employes".
      *[[http://community.powerbi.com/t5/Themes-Gallery/bd-p/ThemesGallery|Microsoft Power BI Community "Themes Gallery"]].
      *After creating a Measure move it to a "Card" ( "123" ) visualisation! <code>
Umsatz Measure = Sum('F_Order Details'[Umsatz])
!
Umsatz Adams I =
CALCULATE(
    Sum('F_Order Details'[Umsatz]),
    D_Employees[Last Name] = "Adams"
)

Umsatz Adams in Deutschland =
Calculate(
    Sum('F_Order Details'[Umsatz]),
    D_Employees[Last Name] = "Adams",
    D_Customers[Country] = "Germany"
)

Umsatz Adams und Buchanan =
CALCULATE(
    [Umsatz Measure],
    D_Employees[Last Name] = "Adams" ||
    D_Employees[Last Name] = "Buchanan"
)

Umsatz Adams II =
Calculate(
    Sum('F_Order Details'[Umsatz]),
    D_Employees[Employee ID] = 4 //4 ist die ID für Adams
)

Gesamtumsatz =
CALCULATE(
    [Umsatz Measure],
    All('F_Order Details')
    
Anteil Umsatz = DIVIDE([Umsatz Measure],[Gesamtumsatz])

Umsatz nach Shipped Date =
Calculate(
    Sum('F_Order Details'[Umsatz]),
    USERELATIONSHIP(Datumstabelle[Date], F_Orders[Shipped Date])
)
</code>
      -The free event [[http://www.datenpioniere.de/events/bi-arena-remote|DatenPioniere "BI Arena remote"]], <del>[[http://www.bi-arena.de/|BI Arena by DatenPioniere ( bi-arena.de )]]</del>.
        *2023-09-12, 08:30 - 14:15 - Virtual event. I joined :-).
          *[[http://www.airmeet.com/e/9a4c0620-36b8-11ee-9361-67cc65bd7812|Airmeet "BI Arena by DatenPioniere"]].
        *2024-12-10, 9:00 - 13:00 - Virtual event.
      -The free event [[http://www.datenpioniere.de/events/bi-arena-schalke|DatenPioniere "BI Arena auf Schalke"]] at Veltins Arena, Rudi-Assauer-Platz 1, 45891 Gelsenkirchen, 2025-01-29, 8:00 – 14:30.
        *I applied, but was rejected: "Leider sind die Plätze vor Ort rar, daher sind diese für Endkunden reserviert" :-(.
  -"M365 Summits".
    *See [[microsoft.html|Microsoft & Microsoft Partners & Third Party Services]].
  -Online events by [[http://www.biordie.com/|BI or DIE Self Service]].
    *[[http://www.linkedin.com/company/reportingimpulse/|LinkedIn "BI or DIE"]].
    *[[http://www.youtube.com/c/BIorDIEbyreportingimpulse|YouTube "BI or DIE by reportingimpulse"]].
    *Podcast series [[http://www.biordie.com/podcast-bi-or-die-self-service|BI or DIE Self Service "Podcast"]].
    *Events are linked with banners, on the title page:
      *[[http://www.biordie.com/data-talk|BI or DIE "Women in Data"]], 2023-03-08.
      *[[http://www.biordie.com/data-talk|BI or DIE "Data Talk"]], 2023-03-31.
      *"BI or DIE "Levelup 2022", 2023-04-24 - 2023-04-28 => YouTube.
  -Free conferences and expositions [[http://www.techshowfrankfurt.de/|Tech Show Frankfurt]] / [[http://www.bigdataworldfrankfurt.de/|Big Data & AI World]], [[http://www.cloudexpoeurope.de/|Cloud Expo Europe Frankfurt]] / [[http://www.datacentreworld.de/|Data Centre World]] in Frankfurt, 2023-05-10 - 2023-05-11.
  -[[http://www.evaco.de/veranstaltungen/datatalk-events/datatalkcongress/|EVACO GmbH]].
    *[[http://www.evaco.de/veranstaltungen/|EVACO GmbH "Veranstaltungen"]]:
      -[[http://www.evaco.de/veranstaltungen/datatalk-events/datatalkmeetup/|EVACO GmbH "#datatalk meetup online"]].
      -Event "#datatalk congress", usually in the Ruhrgebiet area, NRW.
        -"#datatalk congress 2015".
        -"#datatalk congress 2016".
        -"#datatalk congress 2017".
        -"#datatalk congress 2018".
        -"#datatalk congress 2019".
        -"<del>#datatalk congress 2020</del>" - Canceled.
        -[[http://www.evaco.de/microsite/datatalk-congress-2021/|EVACO GmbH "#datatalk congress 2021"]]. 
        -[[http://www.evaco.de/microsite/datatalk-congress-2022/|EVACO GmbH "#datatalk congress 2022"]]. 
        *[[http://www.evaco.de/news-datatalk2022/|EVACO GmbH "Entscheidend ist die passende Strategie – EVACO #datatalk 2022"]] - "Weitere Informationen zum Event der EVACO am 18. Oktober 2022 sowie die kostenfreie Anmeldung finden Sie auf unserer #datatalk congress Eventseite".
      -[[http://www.evaco.de/microsite/datatalk-congress-2023/|EVACO GmbH "#datatalk congress 2023"]], 2023-09-26. I joined :-).
        *"SAVE THE DATE #datatalk congress 2023 Di, 26.09.2023 Oktogon, Zeche Zollverein Essen" ( advertised on [[http://www.evaco.de/news-datatalk2022/|EVACO GmbH "Entscheidend ist die passende Strategie – EVACO #datatalk 2022"]] ).
        *Workshops:
          *"DataRobot Workshop" - Own notebook computer required ( "Sie brauchen nur etwas Entdeckergeist und einen internetfähigen Laptop (als Browser empfehlen wir Google Chrome)" ).
          *"Qlik AutoML Workshop" - No own notebook computer required.
        *Conference app: 
          *[[http://evacoevents.zohobackstage.eu/datatalk-congress-2023|Zoho Backstage "#datatalk congress 2023"]].
          *[[http://play.google.com/store/apps/details?id=com.zoho.backstage|Google Play "Zoho Backstage for Attendees"]].
        *Conference location: [[http://www.oktogon.tv/|Oktogon]], [[http://www.zollverein.de/eventlocations/eventlocations-auf-zollverein/oktogon/|Zeche Zollverein "Oktogon"]], [[http://de.wikipedia.org/wiki/Zeche_Zollverein|DE.Wikipedia "Zeche Zollverein"]].
      -<del>[[http://evacoevents.zohobackstage.eu/ThoughtSpotWorkshop-Frankfurt|EVACO GmbH "ThoughtSpot Workshop"]]</del> in Frankfurt, 2024-03-13, 10:00-15:30 - Canceled :-(.
      -[[http://evacoevents.zohobackstage.eu/K4Workshop-Duisburg|EVACO GmbH "K4 Workshop"]] in Duisburg, 2023-04-11, 10:00-16:00 - I joined :-).
      -"#datatalk congress 2024", 2024-09-12. I was rejected :-(.
        *Conference location: [[http://www.oktogon.tv/|Oktogon]], [[http://www.zollverein.de/eventlocations/eventlocations-auf-zollverein/oktogon/|Zeche Zollverein "Oktogon"]], [[http://de.wikipedia.org/wiki/Zeche_Zollverein|DE.Wikipedia "Zeche Zollverein"]].
        *2024-08-22: "Ihre Registrierung für den datatalk-congress-2024 wurde von ... storniert" :-(, 2024-09-04: "In der Tat ist das Event unseren Kunden und Interessenten vorbehalten. Wir bieten hier unsere Softwarelösungen und Knowhow an. Daher ist für Kunden und Interessenten dieses Event auch kostenfrei.  Deswegen müssen wir aber auch etwas genauer schauen und eben andere Berater ausladen. Hierbei spielt die Firmengröße oder Selbstständigkeit keine Rolle. Wir haben bei Ihnen in der Vergangenheit bereits Ausnahmen gemacht – beim #datatalk im letzten Jahr sowie dem K4 Workshop. Mehr ist nun allerdings nicht möglich. Bitte behalten Sie uns in guter Erinnerung" :-(.
    *[[http://www.linkedin.com/company/evaco-gmbh/|LinkedIn "EVACO GmbH"]].
      *[[http://www.linkedin.com/company/evaco-gmbh/posts/|LinkedIn Posts "EVACO GmbH"]].
  -[[http://www.barc.com/de/events/bi-analytics-arena/|BARC GmbH "BI & Analytics Arena. Marktführende Tools im Vergleich"]], 2023-03-22.
    *[[http://u17261193.ct.sendgrid.net/ls/click?upn=IyCi1KSn1xQiAsnXCXhObgmypxnBNh0cIyvksSDkWRZBQqHA8YpnU6gQOt1kmEJLjxlThI-2F3Doq36lAAYChBcQ-3D-3DnGV9_UMbza9sTicZEEDrz-2FOaWtGn-2BbPuB8t4fbTbQ5CiKR2b4SaABgQGteb-2B8Wt2b7C3EyLTAP1sNvIcsla0itNkIYpPGC3XLLm1kQMqPOQXWgcLymBmMK-2FfDqm-2BXPQoFlg8xt6phBcpTCQ-2FXH-2FRZly1P6ygkdho673pixvvc6X0Kl0KA4Bwa-2FKrzCFKpbFenvUAs4pWJ0ui-2BMRaos2dppg-2BeELYMSkwUEyuMCXQaZhxQyQqHniSXxpE-2BV74DiB9fk4FzvarciSJd-2Fbf-2FpZYG0B3RGvyjSEzWCW0f3VjHW4icIWz-2FsIOkn-2BFk82XTUBKjN2f92v-2FiHlTuvvc7BUrQ29mrEhxu8g1iX2kOSIZp-2BHbXLsjHouMcB6B3YK-2FO1YOLrEb2YYx4oFmmAq5QmVJcfDjvSEgUI8Lp6rKMcTVff6pDDeM-3D|BARC GmbH "BI & Analytics Arena" - Login]], Login Code "3744".
  -[[http://www.elastic.co/|ElasticON]].
    *Free conference [[http://www.elastic.co/events/elasticon/munich|ElasticON "ElasticON Tour Munich"]] in München, 2024-11-14.
      *Free hands-on workshops.
        -"Observability".
        -"Search".
        -"Security.
==== International ====
  -[[http://www.datatalks.club/|DataTalks.Club]] - "Free Data Engineering course!" ( on demand ).
    *[[http://www.github.com/DataTalksClub/data-engineering-zoomcamp|GitHub "DataTalksClub / data-engineering-zoomcamp"]].
  -[[http://www.solutionmonday.com/|Solution Monday]].
    *[[http://events.solutionmonday.com/events|Solution Monday "Events"]].
      *The free online conference [[http://datastacksummit.com/|Data Stack Summit]]- "Live virtual peer-to-peer sessions".
        *[[http://www.datastacksummit.com/twentytwentytwo/|Data Stack Summit 2022]].
        *[[http://www.datastacksummit.com/#2023-agenda|Data Stack Summit 2023]], 2023-04-19.
      *The free online conference [[http://www.datateamssummit.com/|Data Teams Summit]] ( 2023, 2024 ) &  [[http://www.dataopsunleashed.com/|DataOps Unleashed]] ( 2022 ) - "Live virtual peer-to-peer sessions".
        *[[http://events.solutionmonday.com/e/Data-Teams-Summit-2024|Solution Monday "Data Teams Summit 2024"]], 2024-01-24.
          *[[https://u19715574.ct.sendgrid.net/ls/click?upn=mx6Lymf8bqkgOOBcfW-2BhARxbQI230EuVhpxHeMp0SSjdnUSDYezBjI2TAb7sLktYJk1ZRGHIlWSz9t61qwOrggMtEFwoR9pDYiHHYm65-2FECwFzJkZz7eWrmub00zIO8DhPZfBzuL0oXtKyPpptUCdzAuoMyvj4zgQH1uc-2B4Z97AnRBUMITJSSxByc-2BPQ0vVoQS1bwNTe2CT6KRppkRBv8L8t4WBrGHGahJ990UjqTdLwZWcc0AvezvAG1RgOVp4zt2KC3L2oi6obhj-2FJq929RA-3D-3D27Bt_mhOJRsAZ7n8H-2FIjgGaqXKWGK6L0nxf3oaiBS0YJKo2FK1x7zRN55RSbS6M38bX18t-2Fqn-2FVK7UWYagXHsFcLYTqvdDmc-2FXfSK1w4P1SnMfQsf750RtTlfTzuYtDUnWzfnfUkZEkO6FytNabWSaHaCue-2B3hAjW2o42MZzJU1VVH1I5Jm-2FjzPWLMiHPIApVB-2BGYVDGDvmAb0jvAczIxv28ix3yWPL7SSBk5eyEXIguLKNPB4GgJLL0EuB3o6ebW0q5Q|Data Teams Summit 2024 - Personal Link]], 17:00 - 23:00 CET.
        *[[http://events.solutionmonday.com/e/data-teams-summit-2023|Solution Monday "Data Teams Summit 2023"]], 2023-01-25 - 2023-01-26.
        *[[http://events.solutionmonday.com/e/dataopsunleashed2022|Solution Monday "DataOps Unleashed 2022"]], 2022-02-02 - 2022-02-23.
    *The free online conference [[http://dataagilityday.com/october2021/|Data Agility Day]], 2021.
  -[[http://www.globaldatasummit.com/|Global Data Summit]] in USA ( 2017, 2019 ).
  -The affordable commercial online event [[http://www.globalpowerbisummit.com/|Power BI Summit]], 2023-03-06 - 2023-03-10.
  -The free live virtual event [[http://www.opensourcedatasummit.com/|Open Source Data Summit]] ( OSDS ).
    *2023-11-15.
    *2024-??-??.
===== Software =====
==== Free ETL Software ====
=== Free Tools ===
  *The OpenSource [[http://www.apatar.com/|apatar - connecting data]] - "Open Source Data Integration & ETL".
    *[[http://www.apatar.com/news/blog/page-3|apatar - News/Press Releases]] - "Apatar, the open source leader in data mashup integration".
    *[[http://www.apatar.com/why_apatar.html|apatar - Why Apatar?]].
      -Flexible Deployment Options.
      -No Coding! Visual Job Designer.
      -No Coding! Transformation Mapper.
    *[[http://www.apatarforge.org/|ApatarForge]].
  *The OpenSource [[http://www.cloveretl.com/|CloverETL]] by [[http://www.javlin.eu/|Javlin a.s.]] - "Rapid Data Integration Software and Open Source ETL Tool".
    *[[http://www.cloveretl.com/products/open-source|CloverETL "Open Source & Community Edition"]].
    *[[http://www1.cloveretl.com/community-edition|CloverETL "CloverETL Community Edition"]].
    *Blog [[http://blog.cloveretl.com/|ClovertETL Blog "CloverETL Blog on Data Integration"]].
    *[[http://www.github.com/CloverETL|GitHub "CloverETL"]].
    *[[http://cloveretl.sourceforge.net/|SourceForge "CloverETL"]], [[http://www.sourceforge.net/projects/cloveretl/|SourceForge "CloverETL"]] - "Rapid data integration framework".
  *The OpenSource [[http://www.talend.com/|Talend Open Studio]].
    *[[http://www.talendforge.org/|Talendforge]].
    *[[http://en.wikipedia.org/wiki/Talend_Open_Studio|EN.Wikipedia "Talend Open Studio"]].
=== Resources ===
  *[[http://www.alooma.com/blog/open-source-etl-tools-comparison|alooma "Open Source ETL Tools Comparison"]].
==== Free BI Software ====
=== Free Data Warehouse Solutions ===
  *"MariaDB AX" -> See [[databases.html|Data Processing 1/7 - Databases, Webserver, Webservices, SQL, XML]].
=== Free BI Tools ===
  *The OpenSource [[http://superset.apache.org/|Apache Superset]].
    *[[http://en.wikipedia.org/wiki/Apache_Superset|EN.Wikipedia "Apache Superset"]].
  *The free [[http://www.ataccama.com/en/products/dq-analyzer/|Ataccama "DQ Analyzer"]] - "Advanced Data Profiling Tool" for Windows.
  *The OpenSource BI reporting tool [[http://www.eclipse.org/birt/|Eclipse BIRT]] by [[http://www.actuate.de/|Actuate Corporation - The BIRT Company]].
    *[[http://www.birt-exchange.com/|BIRT Exchange]] - "Products and Services for BIRT", "Get the most out of BIRT".
    *BIRT uses JDBC to access databases. To access an ODBC-only database on Windows, you need a JDBC-ODBC Bridge Driver. The features of the JDBC drivers determine what BIRT can make from the databases, e.g. concerning support of standard and non-standard SQL datatypes ect.
    *The fictive company of the sample database is "Classic Models Inc.".
    *[[http://www.actuate.com/products/birt-ihub-ftype/|Actuate Corporation - The BIRT Company "BIRT iHub F-Type. New Free BIRT Server"]].
    *Commercial competitors: [[http://www.ibm.com/software/de/data/cognos/|IBM Cognos]], [[http://crystalreports.com/|Crystal Reports]], [[http://www.qlikview.com/|QlikView]].
  *The free [[http://www.jaspersoft.com/|Jaspersoft Business Intelligence Suite, Community Edition]].
    *[[http://www.jasperforge.org/|JasperForge]].
  *[[http://www.knime.com/|KNIME - Open for Innovation]].
    *[[http://www.knime.com/knime-software|KNIME "KNIME Software"]].
      *The OpenSource [[http://www.knime.com/knime-software/knime-analytics-platform|KNIME "KNIME Analytics Platform - Open, intuitive, integrative data science"]].
    *[[http://www.knime.com/knime-community|KNIME "KNIME Community"]].
      *[[http://www.knime.com/community|KNIME "Community Contributions"]].
  *The free [[http://www.microstrategy.com/freereportingsoftware/learnmore/microsoft-analysis-services-ssas.asp|MicroStrategy Reporting Suite for Microsoft Analysis Services]].
    *[[http://resource.microstrategy.com/Support/|MicroStrategy - Support Site]].
    *[[http://resource.microstrategy.com/ResourceCenter/|MicroStrategy - Resource Center]].
    *[[http://www.microstrategy.de/|MicroStrategy Deutschland GmbH]].
    *Free online trainings [[http://www.microstrategy.de/education/online/|MicroStrategy Deutschland GmbH - "Kostenloses Online Training"]].
    *The free [[http://www.microstrategy.de/BI-application-jumpstart/|MicroStrategy - "Das MicroStrategy Jump-Start Projekt"]].
  *The free [[http://www.oracle.com/technetwork/developer-tools/warehouse/|Oracle Warehouse Builder (OWB) 11g]].
    *"OWB 11.2 is installed as part of every Oracle Database 11g Release 2 installation".
    *The OWB is linked to a specific version of Oracle Database. So you can´t use OWB 11.2 with Oracle 12 database. As OWB is discontinued, there will be no newer version available for newer Oracle databases ( e.g. Oracle 12,.. ) :-(.
    *[[http://en.wikipedia.org/wiki/Oracle_Warehouse_Builder|EN.Wikipedia "Oracle Warehouse Builder"]].
  *[[http://www.ow2.org/|OW2 Consortium]] - "Leading open source middleware".
  *[[http://www.qlikview.com/|QlikTech International AB "QlikView"]].
    *Software:
      *"QlikView".
        *The free [[http://www.qlik.com/try-or-buy/download-qlikview|QlikTech International AB "Download QlikView Personal Edition. Experience the power of Qlik on your personal computer"]], [[http://global.qlik.com/de/explore/products/qlikview/free-download|QlikTech International AB "Seeing is Believing. Downloaden Sie QlikView noch heute!"]] for Win64 "Qlik lädt Sie dazu ein, sich die QlikView Personal Edition downzuloaden. Diese ist keine Testversion, sondern eine komplette Version unserer leistungsfähigen Business-Discovery-Software".
        *"QlikView 12" is a local server application for Win64 computers, with a rich client applications for Win64. 
        *"QlikView 11" was the latest edition with both Win64 and Win32 server and client applications.
        *"QlikView" is more complex than "Qlik Sense", i.e. for domain experts with good software programming skills.
        *Book [[http://www.amazon.de/exec/obidos/ASIN/1849686068/hemmerling-21|Barry Harmsen, Miguel Garcia "QlikView 11 for Developers"]].
          *Accompanying website [[http://www.qlikviewfordevelopers.com/|QlikView 11 for Developers]]. 
        *Application developers need both the "QlikView" application server and rich client. 
        *Important commands:
          *By "File / Edit Script" you may create and modify the query code to access and filter the data of the project.
          *By "File / Table Viewer" you may view the table structure of the project.
        *With "QlikView", you must import each single spreadsheet worksheet, e.g if a spreadsheet file consists of 3 worksheets, you must do 3 manual imports.
      *"Qlik Sense".
        *The free [[http://www.qlik.com/try-or-buy/download-qlik-sense|QlikTech International AB "Download Qlik Sense Desktop. Experience the power of Qlik on your personal computer"]], [[http://global.qlik.com/de/explore/products/sense/desktop|QlikTech International AB "Download von Qlik Sense Desktop. Kostenfreie Self-Service Datenvisualisierung und Discovery - vertrauen Sie Ihrer Intuition"]] for Win32 or Win64 - "Qlik Sense Desktop ist eine kostenfreie Windows Desktop Applikation, mit der Einzelpersonen über Drag-and-Drop interaktive Datenvisualierungen, Reports und Dashboards aus verschiedensten Datenquellen erstellen und teilen können. Gewinnen Sie in nur 5 Minuten mehr Einsichten in Ihre Daten!".
        *"Qlik Sense" is a local server application for Win64 computers. You may operate with the desktop client "Qlik Sense Desktop" - which is a modified browser - or may use a standard Internet browser instead, by calling URLs:
          *[[http://localhost:4848/hub|QlikSense HTML Client "http://localhost:4848/hub"]].
          *[[http://localhost:4848/dev-hub|QlikSense Developer HTML Client "http://localhost:4848/dev-hub"]].
        *Application developers just need the "Qlik Sense" (enterprise) application server, on which the application is published. 
        *"Qlik Sense" is more simple than "QlikView", i.e. for domain experts without software programming skills.
        *I was told by sales staff in 2016, that new customers prefer to order "Qlik Sense" prior to "QlikView".
      *The online service [[http://www.qlik.com/try-or-buy/join-qlik-sense-cloud|QlikTech International AB "Join Qlik Sense Cloud. Experience the power of Qlik on your personal computer"]] with free entry-level account offer.
        *With "Qlik Sense", you may import a spreadsheet at once, e.g if a spreadsheet file consists of 3 worksheets, you must just do one import.
    *Experts told me about filtering:
      *Filters work as associative logic in context.
      *A number of filters may may be applied to an Qlik application.
      *If you apply data filtering to the Qlik data model, it is applied to all Qlik applications which use it.
      *If you apply data filtering to a Qlik application, it is applied to the single Qlik application.
    *Design rules for dashboards:
      *Simple rule:
        *Left side = "Filter".
        *Right side = "Information".
      *Resources:
        *[[http://www.google.de/search?q=qlik+design+rules+for+dashboards|Google - Search for "qlik design rules for dashboards"]].
        *[[http://community.qlik.com/docs/DOC-7711|Qlik Community "Guide to Dashboard Design.pdf"]] 2014 -> PDF.
        *[[http://community.qlik.com/thread/91796|Qlik Community "design guidelines for qlikview"]], 2013.
        *[[http://community.qlikview.com/thread/29294|Qlik Community "Design Guidelines"]], 2012.
  *The commercial Java application [[http://www.pentaho.com/‎|Pentaho Corporation]], [[http://www.pentaho.de/‎|Pentaho Corporation - Germany]].
    *[[http://www.it-novum.com/|it-novum GmbH]] - German service partner.
    *[[http://community.pentaho.com/|Pentaho Community]].
      *The free [[http://community.pentaho.com/projects/bi_platform/|Pentaho BI Platform / Server. The Pentaho BI platform provides architecture and infrastructure required to build solutions to business intelligence (BI) problems]] = "Pentaho BI Platform Community Edition (CE)".
      *The OpenSource [[http://reporting.pentaho.com/|Pentaho Reporting Project. A collection of primarily focused on the creation, generation and distribution of rich and sophisticated reporting from all sources of information]] = "Pentaho Reporting Community Edition (CE)".
      *The OpenSource [[http://kettle.pentaho.com/|Pentaho Kettle Project. A powerful, metadata-driven ETL tool designed to bridge the gap between business and IT; Turning company's data into increased profits]] = "Pentaho Data Integration Community Edition" ( PDI CE ).
      *The OpenSource [[http://mondrian.pentaho.com/|Penatho Modrian Project. Open source analysis OLAP server written in Java. Enabling interactive analysis of very large datasets stored in SQL databases without writing SQL]] - "Pentaho Analysis Services Community Edition".
      *The OpenSource [[http://weka.pentaho.com/|Pentaho Weka Project. A comprehensive set of tools for machine learning and data mining used to help you understand the business better through predictive analysis]] - "Pentaho Data Mining Community Edition (CE)".
    *The OpenSource Java application [[http://pentaho.sourceforge.net/|SourceForge "Pentaho Business Analytics"]], [[http://www.sourceforge.net/projects/pentaho/|SourceForge "Pentaho Business Analytics"]].
    *[[http://en.wikipedia.org/wiki/Pentaho|EN.Wikipedia "Pentaho"]], [[http://de.wikipedia.org/wiki/Pentaho|DE.Wikipedia "Pentaho"]] - "Pentaho Data Mining used the Waikato Environment for Knowledge Analysis ([[http://en.wikipedia.org/wiki/Weka_%28machine_learning%29|Weka]]) to search data for patterns".
    *[[http://twitter.com/Pentaho|Twitter "Pentaho"]].
    *Third-party applications.
      *[[http://code.google.com/p/pdi-twitter/|Google Code " pdi-twitter. Using Simple Twitter API with Pentaho Data Integration (PDI) version 4.2"]].
  *The commercial [[http://www.sas.com/|SAS]] software.
    *The free [[http://www.sas.com/de_de/software/university-edition.html|SAS University Edition]] - "Kostenlose Statistik Software".
  *The OpenSource commandline application [[http://www.visidata.org/|VisiData]] - "An interactive multitool for tabular data. It combines the clarity of a spreadsheet, the efficiency of the terminal, and the power of Python, into a lightweight utility which can handle millions of rows with ease".
    *[[http://www.github.com/saulpw/visidata|GitHub "saulpw/visidata"]].
  *The OpenSource application [[http://www.cs.waikato.ac.nz/ml/weka/|Weka 3: Data Mining Software in Java]].
    *[[http://en.wikipedia.org/wiki/Weka_%28machine_learning%29|EN.Wikipedia "Weka (machine learning)"]], [[http://de.wikipedia.org/wiki/Waikato_Environment_for_Knowledge_Analysis|DE.Wikipedia "Waikato Environment for Knowledge Analysis"]].
  *The announced "XDEV BI Suite" of "XDEV 4" ?!
    *[[http://www.xdev-software.de/|XDEV Software Corp.]].
=== Free BI Frameworks ===
  *The OpenSource framwork [[http://root.cern.ch/drupal/|CERN "ROOT"]].
    *[[http://EN.wikipedia.org/wiki/ROOT|EN.Wikipedia "ROOT"]], [[http://de.wikipedia.org/wiki/ROOT|DE.Wikipedia "ROOT"]].
    *ROOT software script can also be executed by the C++-Interpreter CINT.
  *The OpenSource Python library "pandas" -> See [[python.html|Python]].
=== Data Cleanup ===
  *The OpenSource [[http://www.openrefine.org/|OpenRefine]], [[https://www.github.com/OpenRefine|GitHub "OpenRefine"]] ( formerly: "Google Refine" ) - "A powerful tool for working with messy data: cleaning it; transforming it from one format into another; and extending it with web services and external data".
  *[[http://en.wikipedia.org/wiki/OpenRefine|EN.Wikipedia "OpenRefine"]].
=== Machine Learning ===
== Important Machine Learning Tools according to "Developer Economics - National Trends Survey", 2016-04 ==
  *IBM Watson	
  *BigML	
  *SAS Enterprise Miner	
  *R platform	
  *Python machine learning libraries	
  *Google Prediction API	
  *WEKA Machine Learning Workbench	
  *Microsoft Azure Machine Learning	
  *AWS Machine Learning	
  *TensorFlow	
  *PredictionIO	
  *MATLAB or Octave	
  *DMTK	
  *IBM SPSS Modeler	
  *Apache Spark	
  *RapidMiner	
== Tools ==
  *The OpenSource library [[http://www.tensorflow.org/|Tensorflow]], [[http://www.github.com/tensorflow|GitHub "tensorflow"]] - "TensorFlow is an Open Source Software Library for Machine Intelligence", "Open source software library for numerical computation using data flow graphs".
  *[[http://www.github.com/google/skflow|GitHub "google/skflow"]] - "Simplified interface for TensorFlow (mimicking Scikit Learn)".
== Resources ==
  *[[http://bgr.com/2015/11/09/google-tensorflow-machine-learning-system/|BGR "Google wants everyone to have access to its machine learning technology"]], 2015-11-09.
  *[[http://www.kdnuggets.com/2015/11/google-tensorflow-deep-learning-disappoints.html|KDnuggets - Data Mining, Analytics, Big Data, and Data Science "TensorFlow Disappoints – Google Deep Learning falls shallow"]], 2015-11.
  *[[http://www.lifehacker.com.au/2015/11/googles-tensorflow-could-be-a-game-changer-in-the-future-of-ai/|Lifehacker Australia "Google's TensorFlow Could Be A Game-Changer In The Future Of AI"]], 2015-11.
  *[[http://www.techinsider.io/what-is-google-tensorflow-2015-11|Tech Insider "Google's new artificial intelligence tool has massive potential]], 2015-11-10.
  *[[http://www.wired.com/2015/11/google-open-sourcing-tensorflow-shows-ais-future-is-data-not-code/|Wired "Google Open-Sourcing TensorFlow Shows AI’s Future Is Data"]], 2015-11-16.
==== Microsoft BI Tools ====
=== The free standalone Microsoft Power BI ===
== The Tool ==
  *[[http://www.powerbi.com/|Microsoft Power BI]], [[http://powerbi.microsoft.com/|Microsoft Power BI]].
    *The free dashboard tool "Power BI Desktop for Windows" for Win7, Win8 - "Analytics tools at your fingertips".
  *[[http://community.powerbi.com/|Microsoft Power BI Community]].
    *Blog [[http://community.powerbi.com/t5/Community-Blog/bg-p/community_blog|Microsoft Community Blog]].
    *[[http://powerbi.microsoft.com/en-gb/documentation/powerbi-service-get-started/|Microsoft Power BI "Power BI Support. Get help and support for Power BI"]].
    *[[http://community.powerbi.com/t5/Desktop/I-fail-with-simple-two-row-data-visualisation-please-help/m-p/19177#M5750|Microsoft Power BI Community "I fail with simple two-row data visualisation - please help"]].
== Online Services ==
  *"You've selected Microsoft Power BI. Let's get you started. XXX looks like a personal email address. Enter your work address so we can connect you with others in your company. And don't worry. We won't share your address with anyone. Sign in with a work email address" :-(.
    *The publishing service "Power BI", just for users of the commercial "Office 365" service?! - "The easy way to see your important data in one place. With a few clicks, connect to data from applications you use and get started with pre-built dashboards from experts". 
== Downloads ==
  *[[http://powerbi.microsoft.com/en-us/downloads/|Microsoft Power BI Community "Downloads"]].
  *[[http://www.microsoft.com/en-us/download/details.aspx?id=45331|Microsoft Download Center "Microsoft Power BI Desktop"]].
    *Just for users of the commercial "Office 365" service?! 
  *[[http://www.microsoft.com/en-gb/store/apps/microsoft-power-bi/9nblgggzlxn1|Windows Store "Microsoft Power BI"]].
  *[[http://play.google.com/store/apps/details?id=com.microsoft.powerbim|Google Play "Microsoft Power BI"]] for Android smartphones, "Requires Android 4.4 and up".
    *Just for users of the commercial "Office 365" service?!
    *But Google Play refuses installation "Your Device isn´t compatible with this version" on simulator Bluestacks with "Android 4.4.2".
== Resources ==
  *"Microsoft Power BI" is a dashboard tool, not a reporting tool!
    *It is powered by "Microsoft SQL Server Analysis Services (SSAS)".
    *It is now easy to catch data from HTML pages ( e.g. data tables of Wikipedia ).
    *Data visualisation:
      *Built-in graphics ( by a graphics engine similar / identical to that known from Micrsoft Excel, Microsoft SQL Server Reporting Services and Microsoft SQL Server Analysis Services ).
      *There is an API by which third parties may offer own visualisations.
    *Indeed with Microsoft Excel 2016, you may create the same dashboards, but you can´t publish it on the web.
  *You may save "Microsoft Power BI Desktop" as in single ".pbix" files. Experts told me, that for saving a project, the software needs 3 times of the RAM memory as needed for the loaded data. So it might be that you may load big data, but are not able to save it. In general, this might not be a problem with the 32-bit edition ( on Windows PCs with 2 or 3 GByte of RAM ), but also with the 64-bit edition ( i.e. a project may be saved on a Win64 computer with 16 GB RAM, but not on a Win64 computer with 4 GB RAM ).
  *You might create test cases ( e.g. at business intelligence trainings ) with "Microsoft Power BI", as alternative to NBI.
    *[[http://www.nbi.io/|NBi]], [[http://github.com/Seddryck/NBi|GitHub "Seddryck/NBi"]], [[http://nbi.codeplex.com/|CodePlex "NBI"]] - "Testing framework for Microsoft Business Intelligence platform".
  *"Microsoft Power BI Desktop" also supports the "M" and "DAX" query languages, by the "Advanced Editor" ( "Home / Edit Queries ( = Query Editor ) / Advanced Editor" ).
  *If you install "Microsoft R" prior to "Microsoft Power BI Desktop", you may use "R" for data processing and graphical reporting -> See [[mathengineering.html|Mathematical Engineering]].
  *I was told by experts, in 2016-03:
      *Now legacy versions of "Microsoft Power BI Desktop" were able to process 10.000 datasets for visualisation.
      *Current versions of "Microsoft Power BI Desktop" were able to process 10.0000 datasets for visualisation.
      *With "R" called by "Microsoft Power BI Desktop", you may visualize 150.000 datasets.
=== Commercial Editions of Microsoft SQL Server with BI Support ===
  *See also [[databases.html|Databases, Webserver, Webservices, SQL, XML]].
=== Power BI Gateway - Personal ===
== The Tool ==
  *[[http://www.microsoft.com/en-us/download/details.aspx?id=47753&wa=wsignin1.0|Microsoft Download Center "Power BI Gateway – Personal"]].
== Documentation ==
  *[[http://powerbi.microsoft.com/en-us/documentation/powerbi-personal-gateway/|Microsoft Power BI "Power BI Documentation" - "Power BI Gateway - Personal"]].
  *[[http://powerbi.microsoft.com/en-us/documentation/powerbi-admin-troubleshooting-power-bi-personal-gateway/|Microsoft Power BI "Power BI Documentation" - "Troubleshooting Power BI Gateway - Personal"]].
== Concept ==
  *To get a BI report, connect with a client ( Internet browser, smartphone app,..) to the "Microsoft Power BI" cloudservice. The basic "Power BI" account is free.
  *By this, you may access any cloud document.
  *The cloud servce may access a registered onpremise Windows server at your ( the datacenter of your ) company, if the computer runs a free "Power BI Gateway - Personal" service, by a VPN connection.
    *Experts told me, that the free VPN service shipped with Windows is not under development for some time. Therefore it isn´t very advisable to use it in production environments.
== Resources ==
  *[[http://biinsight.com/power-bi-personal-gateway-five-things-you-must-know/|Business Intelligence Insight "Power BI Personal Gateway, Five Things You Must Know"]].
  *[[http://www.radacad.com/definitive-guide-to-power-bi-personal-gateway|RADACAD Blog "Definitive Guide to Power BI Personal Gateway"]].
  *[[http://www.sysctr.info/2016/01/installing-power-bi-personal-gateway-as.html|#sysctr.info "Installing the Power BI Personal Gateway as a Service Account - Revisited"]].
=== Free Addons for the commercial Microsoft Excel ===
== Tools ==
  *[[http://www.powerpivot.com/|Microsoft PowerPivot]].
  *[[http://www.microsoft.com/en-us/bi/Products/Office.aspx|Microsoft Office 2013 - Business Intelligence]].
    *Powerful BI Now Available in Excel 2013:
      -xVelocity In-memory Analytics.
      -Quick Explore, Quick Analysis and Flash Fill.
      -Power View.
      -Power Pivot.
  *Microsoft Power Query for Excel ( formerly: Microsoft Data Explorer for Excel ).
    *[[http://www.office.com/powerbi|Microsoft Power BI for Office. Self-service Business Intelligence for all your data]].
    *[[http://www.microsoft.com/en-us/download/details.aspx?id=39379|Microsoft Download Center "Microsoft Power Query for Excel"]].
    *[[http://office.microsoft.com/en-us/excel-help/start-page-HA104003813.aspx|Microsoft Power Query for Excel Help]].
    *Blogs [[http://blogs.msdn.com/b/business-intelligence/|Microsoft MSDN "Business Intelligence Blogs"]]
      *Blog [[http://blogs.msdn.com/b/dataexplorer/|Microsoft MSDN "Power BI"]] ( formerly: Microsoft MSDN Blog "Data Explorer Microsoft 'Data Explorer' Preview for Excel" ).
=== Query and Data Modeling Languages ===
  *[[http://msdn.microsoft.com/en-us/library/mt244090.aspx|Microsoft MSDN Developer Network "Query and Data Modeling Languages"]].
== Azure Log Analytics Query Language ==
  *See on this page.
== Analysis Services Scripting Language ( ASS ) ==
  *[[http://docs.microsoft.com/en-us/sql/analysis-services/scripting/analysis-services-scripting-language-assl-for-xmla|Microsoft Docs "Analysis Services Scripting Language (ASSL for XMLA)"]].
  *[[http://docs.microsoft.com/en-us/sql/analysis-services/xmla/xml-for-analysis-xmla-reference|Microsoft Docs "XML for Analysis (XMLA) Reference"]].
  *[[http://technet.microsoft.com/en-us/library/ms126675(v=sql.105).aspx|Microsoft TechNet "Introducing Analysis Services Scripting Language"]].
  *[[http://technet.microsoft.com/en-us/library/ms187178(v=sql.90).aspx|Microsoft TechNet "XML for Analysis (XMLA)"]].
  *[[http://en.wikipedia.org/wiki/XML_for_Analysis|EN.Wikipedia "XML for Analysis"]] ( XMLA ).
== Data Analysis Expressions ( DAX ) - Data Modeling Language ==
  *[[http://msdn.microsoft.com/en-us/library/ee634217.aspx|Microsoft MSDN Developer Network "DAX Syntax Reference"]].
  *Tbe OpenSource software [[http://www.sqlbi.com/tools/dax-studio/|SQLBI "DAX Studio"]], [[http://daxstudio.codeplex.com/|CodePlex "DAX Studio"]] for Windows.
    *[[http://exceleratorbi.com.au/getting-started-dax-studio/|Excelerator BI "Getting Started with DAX Studio"]].
    *Experts told me, that you may connect from "DAX Studio" to a (running) PowerBI model.
== "M" Language ( "Power Query Formula Language" / Microsoft Power Query for Excel Formula Language" ) ==
  *[[http://msdn.microsoft.com/en-us/library/dd285271.aspx|Microsoft MSDN "The Microsoft code name "M" Modeling Language Specification - Introduction"]].
  *[[http://pqreference.azurewebsites.net/|pqreference.azurewebsites.net]].
    *[[http://pqreference.azurewebsites.net/PowerQueryFormulaReferenceAugust2015.pdf|PowerQuery Formula Reference, August 2015]] ( PDF ).
    *[[http://pqreference.azurewebsites.net/PowerQueryFormulaLanguageSpecificationAugust2015.pdf|PowerQuery Formula Language Specification, August2015]] ( PDF ).
  *Blog [[http://blogs.msdn.com/b/mlanguage/|Microsoft MSDN Blog "Codename 'M' Language Team Blog"]].
  *Blog [[http://blogs.msdn.com/b/modelcitizen/|Microsoft MSDN Blog "Model Citizen"]].
    *[[http://blogs.msdn.com/b/modelcitizen/archive/2010/09/22/update-on-sql-server-modeling-ctp-repository-modeling-services-quot-quadrant-quot-and-quot-m-quot.aspx|Microsoft MSDN Blog "Model Citizen: Update on SQL Server Modeling CTP (Repository/Modeling Services, 'Quadrant' and 'M')"]].
  *[[http://www.infoq.com/presentations/Codename-M|InfoQ "Codename 'M': Language, Data, and Modeling, Oh My!"]].
  *[[http://en.wikipedia.org/wiki/M_%28programming_language%29|EN.Wikipedia "M (programming language)"]], [[http://en.wikipedia.org/wiki/Oslo_%28Microsoft%29|EN.Wikipedia "Oslo (Microsoft)"]].
== MultiDimensional eXpressions ( MDX ) ==
  *Tbe OpenSource software [[http://www.sqlbi.com/tools/mdx-studio/|]SQLBI "MDX Studio"], [[http://daxstudio.codeplex.com/|CodePlex "MDX Studio v2"]] for Windows.
  *Microsoft.
    *[[http://docs.microsoft.com/en-us/sql/analysis-services/multidimensional-models/mdx/multidimensional-model-data-access-analysis-services-multidimensional-data|Microsoft Docs "Multidimensional Model Data Access (Analysis Services - Multidimensional Data)"]].
    *[[http://docs.microsoft.com/en-us/sql/mdx/multidimensional-expressions-mdx-reference|Microsoft Docs "Multidimensional Expressions (MDX) Reference"]].
  *[[http://en.wikipedia.org/wiki/MultiDimensional_eXpressions|EN.Wikipedia "MultiDimensional eXpressions"]], [[http://de.wikipedia.org/wiki/Multidimensional_Expressions|DE.Wikipedia "Multidimensional Expressions"]].
== Tabular Modeling Scripting Language ( TMSL ) ==
  *Experts told me, that "Tabular" is like "PowerBI" / "QlickView" / "Tableau" but without graphical user interface and graphical reporting. Instead, "Tabular" may be accessed by any tool by DAX & MDX query language.
  *[[http://docs.microsoft.com/en-us/sql/analysis-services/analysis-services|Microsoft Docs "What is Analysis Services?"]].
    *[[http://docs.microsoft.com/en-us/sql/analysis-services/tabular-model-programming-compatibility-level-1200/tabular-model-programming-for-compatibility-level-1200|Microsoft Docs "Tabular Model Programming for Compatibility Level 1200 and higher"]].
    *[[http://docs.microsoft.com/en-us/sql/analysis-services/tabular-model-scripting-language-tmsl-reference|Microsoft Docs "Tabular Model Scripting Language (TMSL) Reference"]].
  *[[https://www.sqlbi.com/articles/adding-a-measure-to-a-tabular-model/|SQLBI "Adding a measure to a Tabular model"]].
=== Datazen ===
  *[[http://www.datazen.com/|Datazen -  Mobile BI and Data Analytics for Any Device]].
    *"Microsoft Acquires Datazen", 2015-04-14. 
    *The functionality of Datazen is included in "SSRS 2016" for
      -Windows 10 Desktop ( but not Windows Phone! ).
      -Android.
      -iPhone.
==== Data Science Platform by Joshua Görner ====
  *The commercial online course [[http://www.beyond-jupyter.io/|Beyond Jupyter - Take your data science skills to the next level]].
    *[[http://beyond-jupyter.io/page1.html|Beyond Jupyter "Legal Disclosure"]] with E-Mail address of "Joshua Görner".
  *Autor [[http://www.xing.com/profile/Joshua_Goerner2|XING "Joshua Görner"]], [[http://www.linkedin.com/in/jgoerner/|LinkedIn "Joshua Görner"]], [[http://www.github.com/jgoerner|GitHub "Joshua Görner"]].
    *[[http://www.github.com/jgoerner/data-science-stack-cookiecutter|GitHub "jgoerner/data-science-stack-cookiecutter"]].
  *Free conference [[http://www.code-days.de/|SIGS DATACOM GmbH "Code Days"]] as part of the conference [[http://www.oop-konferenz.de/oop2018.html|OOP 2018]] at the [[http://de.wikipedia.org/wiki/ICM_%E2%80%93_Internationales_Congress_Center_M%C3%BCnchen|ICM - Internationales Congress Center München]], München ( 2018-02-17 - 2018-02-18 ). 
     *[[http://www.code-days.de/programm/programm-details/|SIGS DATACOM GmbH "Code Days" - "Programm-Details"]], 2018-02-18 - "Joshua Görner: Beyond Jupyter Notebooks: Build your own Data Science Platform in less than 1 hour".
  *On the TDWI 2018 conference in München, Germany, Joshua Görner ( [[http://www.tdwi-konferenz.de/tdwi2018/programm/konferenzprogramm/sprecher-detail/joshua-goerner.html|TDWI Konferenz 2018, Sprecherdetails "Joshua Görner"]] ) was speaker. I joined his seminar "Beyond Jupyter Notebooks: Build yoru own Data Science Platform in less than 1 hour" :-).
  *Suggested "Data Science Platform":
    -Jupyther.
      *See [[python.html|Python 1/10]].
    -Superset.
      *[[http://superset.incubator.apache.org/|Apache Superset]].
    -PostgreSQL / PostgREST.
      *See [[databases.html|Data Processing 1/5 - Databases, Webserver, Webservices, SQL, XML]].
    -minio.
      *[[http://www.minio.io/|Minio]] - "Private Cloud Storage. Minio is a high performance distributed object storage server, designed for large-scale private cloud infrastructure. Minio is widely deployed across the world with over 105.1M+ docker pulls".
    -API Star.
      *[[http://www.apistar.com/|API Star]], [[http://github.com/encode/apistar|GitHub "encode/apistar"]] - "A smart Web API framework, for Python 3".
      *[[http://docs.apistar.com/|API Star "Docs"]].
    -Docker.
      *See [[virtualization.html|Virtual PCs, Virtual Servers, Virtualization, Virtual Computers, Computer Hardware Simulation]].
      *Book [[http://www.amazon.de/exec/obidos/ASIN/1484230116/hemmerling-21|Joshua Cook "Docker for Data Science: Building Scalable and Extensible Data Infrastructure Around the Jupyter Notebook Server"]].
  *Joshua Görner suggested to use the Python web framework "Flask" to build datascience applications. "Flask" is providing easily "Functions as a Service" for datascience applications. See [[python10.html|Python 10/10 - Web Application Frameworks]]. 
==== "TWDE Datalab" by ThoughtWorks ====
  *[[http://www.github.com/ThoughtWorksInc/twde-datalab|GitHub "ThoughtWorksInc/twde-datalab"]] - "Onboarding to data science by ThoughtWorks".
  *The speech "Mi 9.1: A Hands-on Introduction to Your First Data Science Project" by A. Wider, E. Grasmeder at the conference [[http://www.tdwi-konferenz.de/tdwi2018.html|TDWI Konferenz 2018]] by [[http://www.tdwi.eu/|TDWI Germany e.V.]], 2018-06-25 - 2018-06-27, introduced me to the "TWDE Datalab" :-).
==== Some other commercial BI Software ====
  *[[http://www.bissantz.de/Software|Bissantz & Company GmbH "DeltaMaster: Software für Analyse, Planung und Reporting"]].
  *[[http://www.informatica.com/|Informatica - The Data Integration Company]].
  *[[http://www.intec-international.com/|INTEC International GmbH]] - "Monitoring von Geschäftsdaten mit dem BigData Monitor".
    *[[http://adserver.messe-interactive.de/microsite_new/en/showProduct/Stand/intec-international-gmbh-307187/bigdata-monitor-302155/|Hannover Messe "BigData Monitor"]].
    *The graphical data organisation scheme is:
      -Size of a rectangle.
      -3 colors ( transition from red to white and then to blue ).
      -Label for each rectangle.
    *This is an adoption of the product idea of [[http://w3.win.tue.nl/nl/onderzoek/onderzoek_informatica/visualization/sequoiaview/|Technische Universität Eindhoven "SequoiaView"]].
  *[[http://www.prudsys.de/|prudsys - The Realtime Analytics Company]].
    *[[http://www.clever-empfehlen.de/|prudsys - The Realtime Analytics Company "Clever Empfehlen"]].
    *[[http://www.facebook.com/pages/prudsysde/174016309284459|Facebook "prudsys.de"]].
  *[[http://www.tibco.com/|TIBCO Software Inc.]].
    *The commercial software [[http://spotfire.tibco.com/|TIBCO Software Inc. "Spotfire"]].
      *[[http://www.onthehub.com/tibco/|OnTheHub "Download Spotfire S+ 8.0 for Windows Student Edition]] - Free "TIBCO Spotfire S+ 8.0 (1 Year License)".
    *[[http://developer.tibco.com/|TIBCO Developer Network]].
    *[[http://www.it-production.com/index.php?seite=einzel_artikel_ansicht&id=593|it-production.com -Das Online-Magazin für erfolgreiche Produktion "Zwischen Top Floor und Shop Floor 'Die Zwei-Sekunden-Lücke nutzen'"]] - "Die Frage, ob sich Business Intelligence-Systeme für Auswertungen im Produktionsumfeld genauso eignen wie für Forecast-Aufgaben für das Management..".
    *[[http://de.wikipedia.org/wiki/TIBCO_Spotfire_Analytics|DE.Wikipedia "TIBCO Spotfire Analytics"]].
===== Services =====
==== BigML ====
  *The online cloud based predictive analysis service [[http://www.bigml.com/|BigML]] - "Machine Learning for everyone. Easily add data-driven decisions and predictive power to your company", "NOW FREE. Unlimited tasks ( up to 16 MB/task )".
==== EdgeImpulse Inc. ====
  *[[http://www.edgeimpulse.com/|EdgeImpulse Inc.]]. 
    *[[http://www.edgeimpulse.com/pricing|EdgeImpulse Inc. "Pricing"]] - Free developer account ( "Developer. For developers looking to deploy innovative ML on any edge device = Free" ).
    *[[http://docs.edgeimpulse.com/|EdgeImpulse Inc. Docs]].
      *[[http://docs.edgeimpulse.com/docs/development-boards/fully-supported-development-boards|EdgeImpulse Inc. Docs "Development Boards"]] - "There is a list of development boards that are fully supported by Edge Impulse".
  *Onsite event [[http://www.edgeimpulse.com/edgemlseries|EdgeImpulse Inc. "Presenting Edge ML Series. Frankfurt, Amsterdam, Milan, Paris, London, Munich"]].
      *27-28 April Frankfurt - (27.4.2022 12:00-18:00 and 28.4.2022 8:30-13:00).
      *3 May Amsterdam - (3.5.2022 all day), 08:30-18:00 ( 17:00 ) => I applied and was accepted :-).
        *[[http://www.marriott.com/en-us/hotels/amsrd-renaissance-amsterdam-hotel/|Renaissance Amsterdam Hotel]], Kattengat 1, 1012 SZ Amsterdam, Netherlands.
        *Smartphone app:
          *[[http://mobile-app.marriott.com/|Marriott "Marriott Bonvoy App"]].
          *[[http://play.google.com/store/apps/details?id=com.marriott.mrt|Google Play, Marriott International "Marriott Bonvoy"]].
        *[[http://www.dw.com/de/einreise-und-corona-regeln-niederlande/a-60717029|Deutsche Welle "Einreise- und Corona-Regeln: Niederlande"]], 2022-04-20 - "Einreiseregeln. Die Niederlande gilt aus deutscher Sicht nicht mehr als Hochrisiko-Gebiet. Für Reiserückkehrer aus den Niederlanden entfällt damit die Digitale Einreiseanmeldung, für Ungeimpfte ist keine Quarantäne mehr nötig", "Seit dem 23. März ist die Einreise in die Niederlande ohne Nachweispflicht möglich. Im Land wurden fast alle Corona-Regeln aufgehoben".
      *5-6 July Munich - (5.7.2022 12:00-18:00 and 6.7.2022 8:30-13:00).
==== Google ====
=== Google Colab ( Colaboratory ) ===
  *The free online service [[http://colab.research.google.com/|Google Colab ( Colaboratory )]].
  *A free Jupyter Notebook server, most packages of Anaconda are installed, but not 100% compatible ( different version of Python packages, few missing packages ).
  *User experience of Google Drive users ( so you must be logged into Google Drive by your Google account ): 
    *Create new Jupyter cells.
      *Button "+Code" and menu option "Insert / Code cell" create a new code cell, while "+Text" and menu option "Insert / Text cell" create a new text cell, at the point of the Jupyter notebook, where your cursor is, i.e. where you have hit your mouse by mouse-leftlick. 
      *In local Jupyter notebooks, there is a button of the extra button bar to provide this. This button bar is not available with Google Colab.
    *You may create a copy of a Jupyter notebook put on Google Docs, by "File / Save a copy in Drive".
    *But its most easy to transfer additional data files by downloading them on your local terminal ( PC with browser ), and to upload it into the copied Jupyter Notebook.
    *You might use "Files / Mount Drive" to create the code<code>
from google.colab import drive
drive.mount('/content/drive')
</code>
=== Google Looker ===
  *The commercial online BI tool [[http://cloud.google.com/looker-bi|Google Cloud "Looker for Business Intelligence"]].
==== Microsoft KUSTO ====
=== The Service ===
  *[[http://us.flow.microsoft.com/en-us/connectors/shared_kusto/azure-kusto/|Microsoft "Azure Kusto"]] - "Kusto is a log analytics cloud platform optimized for ad-hoc big data queries".
  *[[http://aka.ms/kdocs|Microsoft KUSTO "Documentation"]], [[http://docs.microsoft.com/connectors/kusto/|Microsoft KUSTO "Documentation]], [[http://kusdocs2.azurewebsites.net/|Microsoft KUSTO "Documentation]] - Not accessable with simple free Microsoft account :-(.
  *[[http://docs.microsoft.com/en-us/connectors/kusto/|Microsoft Docs "Azure Kusto (Preview)"]].
  *[[http://www.github.com/Azure/azure-kusto-python|GitHub "Microsoft Azure Kusto Library for Python"]].
=== Azure Log Analytics Query Language ===
    *[[http://docs.loganalytics.io/|Azure Log Analytics Query Language]].
=== Resources ===
  *[[http://www.squaredup.com/blog/kusto-a-new-query-language-for-oms-log-analytics/|SquaredUp "Kusto: A new query language for OMS Log Analytics"]].
==== SAP HANA ====
=== The Service ===
  *The online cloud based service [[http://hana.sap.com/|SAP HANA]], with free developer account.
    *[[http://account.hanatrial.ondemand.com/|SAP HANA Cloud Platform]] - Login for the free developer account.
      *[[http://account.hanatrial.ondemand.com/cockpit|SAP HANA Cloud Platform "Cockpit"]].
    *[[http://help.hana.ondemand.com/|SAP HANA Cloud Platform Help]].
      *[[http://help.hana.ondemand.com/help/frameset.htm?65d74d39cb3a4bf8910cd36ec54d2b99.html|SAP HANA Cloud Platform Help "Signing Up for a Developer Account"]] - "The name of your new developer account contains your user ID ( e.g. 'p0123456789' ) and the suffix trial ( e.g. 'p0123456789trial' )". However, you still have to login with your SAP ID or E-Mail address, not your developer ID.
    *[[http://scn.sap.com/|SAP Community Network]].
      *[[http://developers.sap.com/|SAP Developer Center]], [[http://scn.sap.com/community/developer-center/|SAP Community Network Developer Center]].
        *[[http://scn.sap.com/community/developer-center/streaming|SAP Community Network "Smart Data Streaming"]].
    *[[http://go.sap.com/developer/hana.html|SAP HANA Developer Center]] - Signup here for a free developer edition account of SAP HANA in the cloud :-).
    *[[http://cal.sap.com/|SAP Cloud Appliance Library]].
  *As of 2016-02, you may install developer editions on SAP HANA Cloud Platform, Microsoft Azure Cloud, Amazon Web Services only. Experts expect, that after 2016-05 there will be a downloadable developer edition and / or a entry-level commercial edition of SAP HANA.
=== Education ===
  *[[http://hcp.sap.com/developers/TutorialCatalog.html/|SAP HANA Cloud Platform "Tutorial Catalog"]].
  *Webcasts.
    *[[http://open.sap.com/courses/hanacloud1-2|openSAP "Introduction to SAP HANA Cloud Platform (Repeat)"]].
    *[[http://open.sap.com/courses/hanacloud2-2|openSAP "Next Steps in SAP HANA Cloud Platform"]].
    *[[http://open.sap.com/courses/iot1|openSAP "How the Internet of Things and Smart Services Will Change Society"]].
  *[[http://www.youtube.com/user/saphanaacademy|YouTube Channel "SAP HANA Cloud Platform"]].
    *[[http://www.youtube.com/playlist?list=PLkzo92owKnVyPLjYRWsjuFj0DFuPPI2qy|YouTube Playlist "SAP HANA Cloud Platform"]].
=== Events ===
  *[[http://scn.sap.com/community/events/codejam|SAP Codejam]].
    *[[http://scn.sap.com/docs/DOC-37775|SAP Community Network "Hosting an SAP CodeJam Event"]].
    *Software to install for the "[[http://scn.sap.com/community/events/codejam|SAP Codejam]] (SAP HANA with IoT)":
      *Node.js.
        *"[[http://www.nodejs.org/|Node.js]] 0.12.10", for use with "Tessel1" boards. See -> [[arm.html|ARM Embedded Systems ( ARM7, ARM8, ARM9, ARM11, Cortex )]].
        *NodeJS for use with Texas Instruments Sensortag. See -> [[wireless.html|Wireless Networks]].
      *Browser [[http://www.google.com/chrome/|Google Chrome]].
      *[[http://www.getpostman.com/|Postman]], [[http://chrome.google.com/webstore/detail/postman/fhbjgbiflinjbdggehcddcbncdddomop|Google Chrome Webstore "Postman"]].
      *HTML/JavaScript editor.
    *[[http://scn.sap.com/community/events/codejam/blog/2016/02/21/recap-iot-codejam-hannover-inwerken-ag|SAP Community Network, SAP CodeJam "Recap IoT CodeJam Hannover at inwerken AG"]].
=== Resources ===
  *[[http://en.wikipedia.org/wiki/SAP_HANA|EN.Wikpedia "SAP HANA"]], [[http://de.wikipedia.org/wiki/SAP_HANA|DE.Wikpedia "SAP HANA"]].

==== Some other commercial BI Tools ====
  *[[http://www.board.com/|Board - The Intelligent Planning Platform]].
  *Google Cloud "Looker for Business Intelligence".
  *[[http://www.k4analytics.com/|K4 Analytics Plan Embed Collect]].
    *[[http://www.evaco.de/|EVACO GmbH]] - German partner of K4.
    *By the help of a "Microsoft Teams" extension, K4 is available on mobile devices ( Android, iPhone ) too :-).
    *Field service employees don't have to learn a BI tool like Qlik, but "just" operate teams. The data can then be exported to K4 via the K4 Extension for Teams.
  *[[http://www.qlik.com|Qlik]].
    *Qlik Extensions:
      *[[http://www.insightsoftware.com/vizlib/|insightsoftware "Vizlib"]]. 
      *[[http://www.timextender.com/|TimeXtender]].
      *K4.
      *Experts told me, that Qlik extensions are not available on mobile devices ( Android, iphone ) :-(.
===== Complex event processing, Streaming Analytics =====
==== Realtime Data Warehouse ====
  *[[http://dssresources.com/papers/features/langseth/langseth02082004.html|Justin Langseth "Real-Time Data Warehousing:
Challenges and Solutions"]].
==== FIWARE "Orion ( Context Broker )" ====
  *See [[fiware.html|FIWARE 1/2]].
==== Google Cloud Stream Analytics Solution ====
  *[[http://cloud.google.com/solutions/big-data/stream-analytics/|Google Cloud "Stream analytics solution"]].
==== Microsoft Technologies for Realtime Data Warehouses ====
=== Microsoft Azure Stream Analytics ===
  *[[http://azure.microsoft.com/en-us/services/stream-analytics/|Microsoft Azure "Azure Stream Analytics"]].
  *[[http://docs.microsoft.com/en-us/azure/stream-analytics/|Microsoft Docs "Stream Analytics Documentation"]].
    *[[http://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs|Microsoft Docs "Stream Analytics Documentation" - "Stream data as input into Stream Analytics"]].
      *"Azure Event Hubs provides highly scalable publish-subscribe **event ingestors**. An event hub can collect millions of events per second, so that you can process and analyze the massive amounts of data produced by your connected devices and applications". 
      *"Together, Event Hubs and Stream Analytics provide an end-to-end solution for real-time analytics. Event Hubs lets you feed events into Azure in real-time, and Stream Analytics jobs can process those events in real-time". 
        *"For example, you can send web clicks, sensor readings, or online log events to Event Hubs. You can then create Stream Analytics jobs to use Event Hubs as the input data streams for real-time filtering, aggregating, and correlation".
    *[[http://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-get-started-with-azure-stream-analytics-to-process-data-from-iot-devices|Microsoft Docs "Stream Analytics Documentation" - "Get started with Azure Stream Analytics to process data from IoT devices"]].
      *"In a real-world scenario, you could have hundreds of these sensors generating events as a stream. Ideally, a gateway device would run code to push these events to Azure Event Hubs or Azure IoT Hubs. Your Stream Analytics job would **ingest these events** from Event Hubs and run real-time analytics queries against the streams. Then, you could send the results to one of the supported outputs"
  *[[http://www.github.com/Azure/azure-stream-analytics|GitHub "Microsoft Azure Stream Analytics"]] - "This repository contains data samples and data generators used for Azure Stream Analytics tutorials".
=== Microsoft SQL Server - StreamInsight ===
  *[[http://msdn.microsoft.com/en-us/library/ee362541.aspx|Microsoft Library "Microsoft StreamInsight"]].
  *[[http://msdn.microsoft.com/en-us/library/gg492088.aspx|Microsoft Library "Columnstore Indexes"]] - Additional technology for "Realtime Data Warehouses".
=== Microsoft KUSTO ===
  *See on this page.


==== Resources ====
  *"Data Ingest" ( German: "etwas ( <del>Nahrung</del> ) zu sich nehmen", "Daten einfügen" ) - If you process data - by machine learning, by statistical methods -, the resulting data is added  ( "ingested" ) to the original data. The term "insert" is not used, as it is already used with SQL.
    *[[http://www.google.com/search?q=%22Data+Ingest%22|Google - Search for "Data Ingest"]].
  *[[http://www.dataversity.net/streaming-analytics-101/|Dataversity "Streaming Analytics 101: The What, Why, and How"]].
    *"SQLstream: Blaze enables companies to be data-driven in real time. Real-time data can be discovered, analyzed, and aggregated instantly, **and delivered as a continuous ingest into** Hadoop, data warehouses, and other enterprise systems".
  *[[http://en.wikipedia.org/wiki/Complex_event_processing|EN.Wikipedia "Complex event processing"]].
  *[[http://de.wikipedia.org/wiki/Edge_computing|DE.Wikipedia "Edge computing"]], [[http://de.wikipedia.org/wiki/Edge_Computing|DE.Wikipedia "Edge Computing"]].
  *[[http://en.wikipedia.org/wiki/Azure_Stream_Analytics|EN.Wikipedia "Azure Stream Analytics"]].
===== Data Analysis & Dashboards =====  
  *Grafana.
    *See [[diagrams.html|Diagrams & Graph Visualization]].
  *Kibana.
    *The OpenSource plugin [[http://www.elastic.co/products/kibana|Elasticsearch Kibana]] - "Explore & Visualize Your Data".
    *[[http://www.elastic.co/guide/en/kibana/|Elastic "Learn, Docs" - "Kibana"]].
      *[[http://www.elastic.co/guide/en/kibana/current/dashboard.html|Elastic "Learn, Docs" - "Kibana Dashboard"]] - "A Kibana dashboard displays a set of saved visualizations in groups that you can arrange freely. You can save a dashboard to share or reload at a later time".
    *[[http://www.timroes.de/2015/02/07/kibana-4-tutorial-part-1-introduction/|Kibana 4 Tutorial]] - "A web frontend to analyze data held in an elasticsearch cluster".
    *[[http://en.wikipedia.org/wiki/Kibana|EN.Wikipedia "Kibana"]] - "Open source data visualization plugin for Elasticsearch".
    *[[http://en.wikipedia.org/wiki/Elasticsearch|EN.Wikipedia "Elasticsearch"]], [[http://de.wikipedia.org/wiki/Elasticsearch|DE.Wikipedia "Elasticsearch"]].

===== Full Text Search =====  
  *Elitness.
    *[[http://www.google.de/search?q=elitness+bm25|Google - Search for "elitness bm25"]].
    *[[https://www.google.de/search?q=The+Probabilistic+Relevance+Framework%3A+BM25+and+Beyond+Contents|Google - Search for "The Probabilistic Relevance Framework BM25 and Beyond"]].
    *[[http://en.wikipedia.org/wiki/Okapi_BM25|EN.Wikipedia "Okapi BM25"]].
    *[[http://dl.acm.org/citation.cfm?id=1704810|ACM Digital Library "The Probabilistic Relevance Framework: BM25 and Beyond"]].
    *[[http://www.staff.city.ac.uk/~sb317/papers/|Stephen Robertson - Papers]].
      *[[http://www.staff.city.ac.uk/~sb317/papers/foundations_bm25_review.pdf|The Probabilistic Relevance Framework: BM25 and Beyond]] ( PDF ).
        *"3.4 The Eliteness Model and BM25. We now re-introduce term frequencies into our model... We suppose that for any document-term pair, there is a hidden property which we refer to as eliteness. **This can be interpreted as a form of aboutness: if the term is elite in the document, in some sense the document is about the concept denoted by the term**. Now we assume that actual occurrences of the term in the document depend on eliteness, and that there may be an association between eliteness (to the term) and relevance (to the query)".
      *[[http://en.wikipedia.org/wiki/Elasticsearch|EN.Wikipedia "Elasticsearch"]], [[http://de.wikipedia.org/wiki/Elasticsearch|DE.Wikipedia "Elasticsearch"]].
  *[[http://en.wikipedia.org/wiki/Full_text_search|EN.Wikipedia "Full text search"]], [[http://de.wikipedia.org/wiki/Volltextrecherche|DE.Wikipedia "Volltextrecherche"]] - "Zur schnellen Informationsgewinnung und dem Auffinden aus bekannten wie auch nicht bekannten (aber auf den Medien vorhandenen) Dokumenten wird die Volltextrecherche genutzt. Die Volltextrecherche dient daher dem Auffinden, Entdecken und Extrahieren unbekannter, nicht trivialer und wichtiger Informationen aus großen Mengen von unstrukturierten Texten/Dateien und ist somit auch ein wichtiger Teilbereich des Text Mining. Sie ist eine Sofortlösung, um für eine konkrete Fragestellung auf Systeme wie Dokumentenmanagement und Data-Mining verzichten zu können".
    *Document management -> See [[cms.html|Content Management Systems ( CMS )]].
    *Data-Mining -> See "Business Intelligence" on this page.

===== Artificial Intelligence =====  
  *[[http://ai-konferenz.sigs-datacom.de/i/saauRFrjB9HV5TNOr4N2Ha6SvmgEQVODzgI_yfJDzMs|AI Spektrum: Ihr Fachportal für Künstliche Intelligenz]].
===== Webcasts. Webinars =====  
  *[[http://www.evidanza.de/bi-webcast/|evidanza AG - BI-Webcast]].
  *[[http://www.compuware.com/en_us/changepoint/resources/on-demand-webcasts.html|Compuware "On-Demand Webcasts"]].
    *Webcast "Essentials of Business Analytics & Big Data: What Every Service Leader Needs to Know".
===== Experts =====
  *[[http://www.aandbi.com/|AandBI.com powered by Grete DV GmbH]] ( [[http://www.xing.com/profile/MarkusAlexander_Grete/|XING "Markus Alexander Grete"]] ), Burgdorf - "Implementierung und Schulung KI, BI, Datenschutz, Implementation and Education, Artificial Intelligence, Business Intelligence and Privacy Law".
===== Literature ======
  *Book [[http://www.amazon.de/exec/obidos/ASIN/0814408648/hemmerling-21|Viktor Mayer-Schonberger, Thomas Ramge: "Reinventing Capitalism in the Age of Big Data"]], 2018.
  *PDF book [[http://www.tdwi.eu/wissen/studien-buecher/e-books/wissen-titel/the-essential-guide-to-machine-data.html|TDWI "The Essential Guide to Machine Data"]], 2019-07.
  *PDF book [[http://www.memsql.com/resources/ebook-oreilly_time_series_2019|MemSQL, Aileen Nielsen "Cutting Edge Approaches to Time Series Analysis"]], 2019-08.

===== Resources =====
  *While commercial editions of OpenSource BI software tools start with 10.000 EUR/a... 50.000 EUR/a for single customers, there are totally different costs, if the customer wants to integrate or bundle the commercial edition of the OpenSource BI software tool with the own software solution to end-customers, as OEM partner :-).
  *I was told by experts, that some business intelligence software tools are not based on multidimensional databases, but SQL, NoSQL,...
  *The competition [[http://www.data-mining-cup.de/|Data Mining Cup]].
  *[[http://www.datasciencecentral.com/profile/RolfHemmerling|Data Science Central]] - "The Online Recourse for Big Data Practitioners".
  *[[http://www.ea-world.de/|enterprise application world @ Hannnover Fair CEBIT]].
  *[[http://www.kaggle.com/|Kaggle: Your Home for Data Science]].
  *[[http://www.kdnuggets.com/|KDNuggets]] - "Data Mining Community's Top Resource".
  *[[http://www.sqlpass.org/|PASS - The Professional Association for SQL Server]].
  *[[http://community.qlikview.com/wikis/|QlikCommunity, Wiki]].
  *[[http://www.speicherguide.de/news/big-data-heisst-loslassen-von-strukturierten-daten-15668.aspx|Speicherguide "Big Data heißt: Loslassen von strukturierten Daten"]] - "Polystrukturierte Daten ist ein neuer Begriff, der strukturierte und unstrukturierte Daten sowie die neuerdings massiv auftretenden maschinengenerierten Daten wie Sensor-Daten und Web-Logs mit einbezieht".
  *Blogs [[http://www.sqlblog.com/|THE SQL Server Blog Spot on the Web]].
    *Blog [[http://www.sqlblog.com/blogs/marco_russo/|THE SQL Server Blog Spot on the Web "SQLBI - Marco Russo"]] - "SQLBI is a blog dedicated to building Business Intelligence solutions with SQL Server".
  *Wikipedia.
    *[[https://en.wikipedia.org/wiki/Cross_Industry_Standard_Process_for_Data_Mining|EN.Wikipedia "Cross Industry Standard Process for Data Mining"]] ( CRISP-DM ).
    *[[http://en.wikipedia.org/wiki/Data_mining|EN.Wikipedia "Data Mining"]], [[http://de.wikipedia.org/wiki/Data-Mining|DE.Wikipedia "Data-Mining"]].
    *[[http://en.wikipedia.org/wiki/Star_schema|EN.Wikipedia "Star schema"]], [[http://de.wikipedia.org/wiki/Sternschema|DE.Wikipedia "Sternschema"]].
    *[[http://en.wikipedia.org/wiki/Data_integration|EN.Wikipedia "Data integration"]], [[http://de.wikipedia.org/wiki/Informationsintegration|DE.Wikipedia "Informationsintegration"]].
    *[[http://en.wikipedia.org/wiki/Operational_data_store|EN.Wikipedia "Operational data store"]], [[http://de.wikipedia.org/wiki/Operational_Data_Store|DE.Wikipedia "Operational Data Store"]].
    *[[http://en.wikipedia.org/wiki/Data_stream_mining|EN.Wikipedia "Data stream mining"]].
    *[[http://en.wikipedia.org/wiki/Mitigation|EN.Wikipedia "Mitigation"]], [[http://de.wikipedia.org/wiki/Folgenminderungsstrategie|DE.Wikipedia "Folgenminderungsstrategie"]] - "Information technology: Mitigation, a kind of defense against security issues in computing, as part of vulnerability management".

===== Forums, Newsgroups =====
  *[[http://www.apatarforge.org/forums/|ApatarForge Forums]].
  *[[http://www.birt-exchange.org/org/forum/|BIRT Exchange Forums]].
  *[[http://forum.cloveretl.com/|CloverETL Forum]].
  *[[http://www.enzeecommunity.com/|ENZEE - The Netezza Community]].
  *Facebook.
    *[[http://www.facebook.com/pentaho|Facebook "Pentaho"]], [[http://www.facebook.com/PentahoCe|Pentaho Business Intelligence - Joaçaba. Community Page about Business Intelligence Consultant]].
    *[[http://www.facebook.com/sapdevelopers|Facebook "SAP Developers"]].
  *[[http://community.informatica.com/|Informatica Commmunities]].
    *[[http://community.informatica.com/community/user_groups|Informatica User Groups]].
      *[[http://community.informatica.com/community/user_groups?view=discussions|Informatica User Groups - Discussions]].
  *[[http://www.jasperforge.org/|JasperForge]].
  *[[http://www.kaggle.com/discussion|Kaggle: Your Home for Data Science "Discussion"]].
  *LinkedIn:
    *[[http://www.linkedin.com/groups?gid=35222|LinkedIn "Advanced Business Analytics, Data Mining and Predictive Modeling"]].
    *[[http://www.linkedin.com/groups?gid=4316541|LinkedIn "Business Intelligence Elite"]].
    *[[http://www.linkedin.com/groups?gid=3028129|LinkedIn "MicroStrategy Business Intelligence"]].
  *Microsoft
    *[[http://community.powerbi.com/t5/Power-BI-User-Groups/ct-p/Groups|Microsoft Power BI Community "Power BI User Groups"]].
      *[[http://community.powerbi.com/t5/Power-BI-User-Group-Hamburg/gp-p/PUGHamburg|Microsoft Power BI Community "Power BI User Groups", "Power BI User Group Hamburg"]].
    *[[http://community.powerbi.com/t5/Forums/ct-p/Forums|Microsoft Power BI Community "Forums"]].
    *[[http://social.technet.microsoft.com/forums/en-us/home?category=powerbi|Microsoft Technet Forums - Questions tagged with "powerbi"]] - "All Power BI related forums have been moved to [[http://community.powerbi.com/|http://community.powerbi.com/]]]. These forums are now locked and read-only. We sincerely apologize for the inconvenience this may have caused you", 2015-07-17:
      *"Power BI Dashboard Preview".
      *"Power BI for Office 365".
      *"Power BI Mobile Apps".
      *"Power BI Q&A".
  *[[http://resource.microstrategy.com/forum/|MicroStrategy Discussion Forums]].
  *[[http://forums.pentaho.com/forum.php|Pentaho Community Forums]].
  *[[http://community.qlik.com/|Qlik Community]].
    *[[http://community.qlik.com/community/qlikview|QlikView Forums & Resources]].
    *[[http://community.qlik.com/community/qlik-sense|Qlik Sense Forums]].
  *[[http://forums.sdn.sap.com/|SAP Community Network Forums]].
  *[[http://wiki.sdn.sap.com/wiki/|SAP Wiki]].
  *[[http://www.talendforge.org/forum/|TalendForge - Talend community forum]].
  *TIBCO.
    *[[http://www.tibcommunity.com/|TIBCOmmunity]].
    *The read-only ancient Forum [[http://spotfirecommunity.tibco.com/community/|TIBCO Spotfire Community]].
    *[[http://www.tibcommunity.com/community/products/analytics|TIBCOmmunity Analytics]].
  *[[http://www.varigence.com/Forums|Varigence Forums]].
{{tag>"business intelligence"}}
<footnote_navi_en>