[hemmerling] Data Processing 2/7 - Descriptions of Data, Data Transfer and Data Protocols

Relates pages:

• Data Processing 1/7 - Databases, Webserver, Webservices, SQL, XML.
• Data Processing 3/7 - NoSQL Databases: Not Just SQL.
• Data Processing 4/7 - Database Managment Tools and Database Application Development Tools.
• Data Processing 5/7 - Business Intelligence.
• Data Processing 6/7 - Data Warehouse Modeling.
• Data Processing 7/7 - Machine Learning.

1. EN.Wikipedia "Entity–relationship model", DE.Wikipedia "Entity-Relationship-Modell".
2. UML → See Unified Modeling Language ( UML ), Systems Modeling Language ( SysML ).

• IBM DeveloperWorks "Get started with the Data Format Description Language".
• EN.Wikipedia "Data Format Description Language" - “DFDL is descriptive and not prescriptive. DFDL is not a data format, nor does it impose the use of any particular data format. Instead it provides a standard way of describing many different kinds of data format”.

• The HDF Group.
• EN.Wikipedia "Hierarchical Data Format", DE.Wikipedia "Hierarchical Data Format".

• See Web Technologies ( HTML5, HTML, XML & Javascript ) 3/5 - Javascript.

• Google Developers "Protocol Buffers" - “A language-neutral, platform-neutral extensible mechanism for serializing structured data”.
• EN.Wikipedia "Protocol Buffers", DE.Wikipedia "Protocol Buffers".

• Microsoft
  • The free Microsoft Download Center "Word 2003: XML Viewer" - to watch Word2003 XML documents on computers without Word2003.
  • The free Microsoft Download Center "XML Notepad 2007" ( = XML Notepad V2.5 ) for Windows with .NET 2.0.
  • The free Microsoft Download Center "Internet Explorer Tools for Validating XML and Viewing XSLT Output " for Windows.
• The OpenSource Notepad++, Sourceforge "Notepad++", Sourceforge "Notepad++" for Windows.
  • SourceForge "Notepad++ Plugins", SourceForge "Notepad++ Plugins" → Notepad++ plugin “XML Tools” for Windows.
• The free Peter's XML Editor, for Windows.
• The free XMLmind XML Editor, Personal Edition for Windows.
• The commercial Altova XMLSpy.
  • Once there was a free “XMLSpy 2005 Home Edition” and “XMLSpy 2006 Home Edition”. Archive.org "Altova - Get your FREE XMLSpy 2006 Home Edition License" ( - 2006-10-19 ).
• The XML editor “EditiX” by JAPISoft, a Java 6 application for Win, Linux and MacOSX.
  • The commercial JAPISoft "EditiX".
  • The free JAPISoft “EditiX Lite”.
    • JAPISoft "EditiX Lite" - “This is a free Edition of EditiX XML Editor for non commercial usage” - Download of “EditiX Lite 2008 SP2” only .
    • JAPISoft EditiX "DTD Editor" - “EditiX is a powerful and easy to use DTD editor”.
    • The online manual JAPISoft "EditiX XML Editor - Manual".
    • JAPISoft - Download of "EditiX Lite" - Download of “EditiX Lite 2010”, “EditiX Lite 2008 SP5”.

• SAX, David Megginson "Simple API for XML".
• EN.Wikipedia "Simple API for XML", DE.Wikipedia "Simple API for XML".
• O'Reilly xml.com - XML from the inside out "David Brownell: Top Ten SAX2 Tips".

• EN.Wikipedia "Java API for XML Processing", DE.Wikipedia "Java API for XML Processing".
• java.net "GlassFish".
  • java.net "GlassFish - Project JAXP" - “JAXP Reference Implementation”.
• The OpenSource Saxonica: XSLT and XQuery Processing, SourceForge "SAXON - The XSLT and XQuery Processor", SourceForge "Saxon XSLT and XQuery Processor" for Java and .NET.
• Torsten Horn "XML, JAXP, StAX, SAX, DOM und JDOM mit Java".
• totheriver "Introduction to XML and XML With Java".
• The Java Community Process Program "JSR 63: JavaTM API for XML Processing 1.1".
• W3C "Document Object Model (DOM) Level 2 Core Specification".
• Brett D. McLaughlin, IBM developerworks "XML and Java technology: Sun's Java and XML APIs: Helping or hurting?", 2007-07-10.
• Apache XML "Using the JAXP Transform APIs".

• SourceForge "<eXpat> - The Expat XML Parser", SourceForge "Expat XML Parser" - “XMLparser library”.
• Kranf site "Small, simple, cross-platform, free and fast C++ XML Parser" - “XMLparser library”.
• TinyXML, SourceForge "TinyXML", SourceForge "TinyXML".
• The Apache Xerces Project.
  • EN.Wikipedia "Xerces".
• The Apache XML Project - Xalan C++ - “An XSLT processor for transforming XML documents into HTML, text, or other XML document types”.
  • EN.Wikipedia "Xalan", DE.Wikipedia "Xalan".

• SourceForge "Python/XML", SourceForge "Python/XML".

• EN.Wikipedia "Apache Cocoon", DE.Wikipedia "Apache Cocoon".

• The OpenSource software DITA Open Toolkit - “The DITA Open Toolkit, or DITA-OT for short, is a set of Java-based, open-source tools that provide processing for DITA maps and topic content”.

• DITA is used with topic-based authoring”.
• Cover Pages, hosted by OASIS "Darwin Information Typing Architecture (DITA XML)".
• IBM Developerworks "Introduction to the Darwin Information Typing Architecture".
• OASIS - Advanced open standards for the information society "OASIS Darwin Information Typing Architecture (DITA) TC".
• EN.Wikipedia "Darwin Information Typing Architecture", DE.Wikipedia "Darwin Information Typing Architecture" - “Ein Dokumentenformat, ähnlich dem bekannten DocBook”.
• EN.Wikipedia "DITA Open Toolkit" - “An open-source publishing system for publishing DITA”.
• dita.xml.org - Online Community for the Darwin Information Typing Architecture OASIS Standard.

• DocBook.org - “DocBook is a schema (available in several languages including RELAX NG, SGML and XML DTDs, and W3C XML Schema) maintained by the DocBook Technical Committee of OASIS”.
• Book Norman Walsh, Richard L. Hamilton "DocBook 5: The Definitive Guide".
  • The free legacy HTML online edition DocBook: The Definitive Guide.
  • The free HTML online edition DocBook 5: The Definitive Guide.
• Book Bob Stayton "DocBook Xsl: The Complete Guide".
• EN.Wikipedia "DocBook", DE.Wikipedia "DocBook".

• PROFIBUS Nutzerorganisation e.V. "Software and Tools" - The “PROFIBUS GSD Editor V5.1.1.0” for Windows is just free for PNO members. Integrated XML parsers are used to check the validity of GSD files, not to build them. These three XML parsers are integrated in the “GSD Editor”:
  1. XML parser which is included in the .NET framework. The equivalent standalone tool is “MSXML 6”.
     • Microsoft Download Center "Microsoft Core XML Services (MSXML) 6.0 Service Pack 1".
     • EN.Wikipedia "MSXML", DE.Wikipedia "MSXML".
     • Microsoft Developer Network "How to: Parse XML with XmlReader".
  2. Apache Xerces.
  3. libxml2 - The XML C parser and toolkit of Gnome.

• The commercial ALTOVA "XMLSpy XML Editor".

• Apache "XML at The Apache Foundation".
• IBM developeworks "C/C++ developers: Fill your XML toolbox. Tools advice for C and C++ programmers ramping up on XML" #.
• Roberto Ierusalimschy "Programming in Lua", chapter "29.2 - An XML Parser".
• Microsoft.
  • MSDN "Data Access and Storage > Lernen > MSXML" / MSDN "Data Access and Storage > Lernen > MSXML".
  • Microsoft Download Center "MSXML 4.0 Service Pack 2 (Microsoft XML Core Services)".
  • Microsoft Download Center "MSXML 4.0 Service Pack 3 (Microsoft XML Core Services)".
  • Microsoft Download Center "Microsoft Core XML Services (MSXML) 6.0".
  • Blog Microsoft XML Team's WebLog.
• O'Reilly xml.com #.
• Quackit "XML with CSS".
• uzi-web.de "< X M L / > Extensible Markup Language" - "XML Parser" - XML parser tutorial.
• w3schools - the world's largest web development site. educate yourself! beginners and experts.
  • w3schools - the world's largest web development site. educate yourself! beginners and experts "XSLT Tutorial".
  • w3schools - the world's largest web development site. educate yourself! beginners and experts "XML Tutorial".
• Wikipedia.
  • EN.Wikipedia "Referential integrity", DE.Wikipedia "Referentielle Integrität".
  • EN.Wikipedia "XML", DE.Wikipedia "Extensible Markup Language".
  • EN.Wikipedia "XPath", DE.Wikipedia "XPath".
  • EN.Wikipedia "XSLT", DE.Wikipedia "XSL Transformation".
  • EN.Wikipedia "XML Schema (W3C)", DE.Wikipedia "XML Schema".
  • EN.Wikipedia "Document Type Definition", DE.Wikipedia "Dokumenttypdefinition.
  • EN.Wikipedia "XML editor", DE.Wikipedia "XML-Editor".
  • EN.Wikipedia "Comparison of XML editors".
  • XML Journal by SYS-CONn MEDIA.

• ADO.NET.
• DataReader, DataAdapter, (typisierte) DataSets.
  • Data Access / Persistence Layer.
• Repository, Data Mapper, Active Record etc.
  • ObjectSpaces, EntLib, Entity Fx, LINQ to SQL.
• Object-Relational Mapping ( ORM ).

• NHibernate.
• SubSonic.
• Castle.ActiveRecord.
• Telerik OpenAccess.
• LightSpeed.
• LINQ to SQL [.NET 3.5].
• ADO.NET Entity Framework [.NET 3.5 SP1].

• EN.Wikipedia "Object-relational mapping", DE.Wikipedia "Objektrelationale Abbildung".

• Simple.Data by Mark Rendle (Windows Azure MVP).
  • Github "markrendle / Simple.Data".
• Massive by Rob Conery (Microsoft, WekeRoad).
  • Github "robconery / massive".
• Dapper by Sam Saffron (StackOverflow).
  • Github "SamSaffron / dapper-dot-net".
  • Google Code "dapper-dot-net. Simple SQL object mapper for ADO.NET".
• PetaPoco by Top Ten Software.
  • Top Ten Software.
    • Top Ten Software "PetaPoco. A tiny ORM-ish thing for your POCOs".
  • Github "toptensoftware / PetaPoco".
  • NuGet Gallery "PetaPoco - A tiny ORMish thing for your POCOs".

• EN.Wikipedia "ADO.NET", DE.Wikipedia "ADO.NET" - Not in focus of .NET developers, anymore.
• EN.Wikipedia "ADO.NET Entity Framework" - The new standard for .NET developers, since 2010 / 2011.

• JBoss Community - Hibernate - “Relational Persistence for Java and .NET”.
• NHibernate Forge. The official new home for the NHibernate for .NET community.
• Once NHybernate was the inofficial “standard” for .NET developers for some time. In 2010 / 2011, the focus of .NET developers was turned by Microsoft to its ADO.NET Entity Framework, which is now the new “standard”.
• EN.Wikipedia "Hibernate (Java)", DE.Wikipedia "Hibernate (Framework)".

• Wikipedia.
  • EN.Wikipedia "Java Database Connectivity", DE.Wikipedia "Java Database Connectivity".
  • EN.Wikipedia "JDBC driver".
  • EN.Wikipedia "Java Data Objects", DE.Wikipedia "Java Data Objects".
• Oracle, Sun Developer Network - Products and Technologies Technical Topics, JDBC(TM) Data Access API, Drivers - Resource for JDBC drivers #.
• Oracle Wiki "JDBC".
• Oracle Technology Network "Java SE Technologies - Database" - JDO, JDBC.
  • Oracle Technology Network "Java Data Objects (JDO)".
• JDBC + foreign keys.
  • “Some JDBC drivers don´t provide foreign keys, as this is not a must-have feature for a JDBC driver”.
  • Java Tips "How to create a table with ForeignKeys from JDBC".

• EN.Wikipedia "LINQ", DE.Wikipedia "LINQ".
• The free LINQPad for .NET 3.5 & .NET 4.0.

• Microsoft Download Center 'Microsoft "Oslo' - May 2009 CTP".
• Microsoft Excel.
  • “Power Query” - Data consolidation.
  • “Power Pivot” ( EN.Wikipedia "PowerPivot" ) - Development of data models and calculations.
  • Power View - Data visualisation of data analysis results.
  • Power Map - Geo visusalisation. You may generate small 3D movie-alike applications for presentations.

• BI BLOG: thatMSFTBIGuy. Microsoft BI technologies simplified, from the consulting man cave "Using Power Query for Excel".
• Microsoft Office "Power Query 101 Importing data from web page".

• Microsoft MSDN "The Microsoft code name 'M' Modeling Language Specification - Introduction".
• ZDNet "Microsoft Oslo modeling platform unravels further; M's future remains vague", 2010-09-22.
• EN.Wikipedia "Oslo (Microsoft)".
• EN.Wikipedia "M (programming language)".

• EN.Wikipedia "MultiDimensional eXpressions", DE.Wikipedia "Multidimensional Expressions".
• EN.Wikipedia "Microsoft Analysis Services".
• Microsoft MSDN Library "Data Analysis Expressions and MDX".

• Goal of DAX: Access to Business Intelligence for Excel users by a smart VBA-alike script language ( “DAY queries” ) .
• Blog Chris Webb's BI Blog.
  • Chris Webb's BI Blog "DAX Queries, Part 1".
  • Chris Webb's BI Blog "DAX Queries, Part 2".
  • Chris Webb's BI Blog "DAX Queries, Part 3".
  • Chris Webb's BI Blog "DAX Queries, Part 4".
• Microsoft MSDN "Tabular Modeling (SSAS Tabular)".
• EN.Wikipedia "Column-oriented DBMS", DE.Wikipedia "Spaltenorientierte Datenbank".

• Microsoft Docs "Tabular Model Scripting Language (TMSL)-Referenz".
• Microsoft Docs "Einführung in die im tabellarischen Objektmodell (TOM) in Analysis Services AMO".
• TMSL is in JSON format.

• Was considered to be outdated when ASP.NET appeared. In focus of the .NET developers, again, since 2008.
• EN.Wikipedia "Open Database Connectivity", DE.Wikipedia "Open Database Connectivity".
• Oracle Wiki "ODBC" - “The ODBC Driver is also available as part of the Oracle Instant Client installation”.
• Oracle Instant Client for Windows, Linux,..
• JDBC-ODBC Bridge Driver.
• Oracle Technology Network - "Oracle Call Interface".
• Microsoft MSDN Library "ODBC Drivers".
• Microsoft Help and Support "ODBC--Open Database Connectivity Overview".

• Oracle Berkeley DB - a computer software library that provides a high-performance embedded database for key/value data.
• EN.Wikipedia "Berkeley DB", DE.Wikipedia "Berkeley DB".

• Reactive Relational Database Connectivity (R2DBC).
  • “In contrast to the blocking nature of JDBC, R2DBC allows you to work with SQL databases using a reactive API.”.
• Spring "Spring Data R2DBC".

• I was told by experts about SQL naming conventions:
  1. Oracle SQL Server: SQL commands and table names are not case sensitive. Internally, they are converted to uppercase, if they are not included in quotation marks.
  2. Postgres is also not case sensitive, but converts all SQL keywords to lowercase.
  3. Oracle MySQL Server is case sensitive or not, depending on th operating system, database engine and settings.
• EN.Wikipedia "SQL", DE.Wikipedia "SQL".
• Salesforce.com Object Query Language (SOQL).

• These frameworks offer propretary interfaces for ( ODBC ) database access:
  • MFC by Microsoft.
  • BDE, suppied with Borland C++ compilers.
  • wxWidgets.
• SourceForge "Oracle, Odbc and DB2-CLI Template Library", SourceForge "Oracle, ODBC, DB2-CLI Template Library" ( OTL ).
• SourceForge "Database Template Library Programmer's Guide", SourceForge "Database Template Library Programmer's Guide" ( DTL ) - “The goal of this library is to make ODBC recordsets look just like an STL container”.
• SourceForge "DBConnect API", SourceForge "DBConnect API".
• Lee Thomason "TinyXML", SourceForge "TinyXML", SourceForge "TinyXML".
• SQLite.

• Databases:
  • Oracle Database.
  • MariaDB.
• Martin Bulinski "PL/SQL Tutorial".
• Morgans Oracle Library Site Map.
• Oracle.
  • Oracle Database SQL Language Reference.
    • Oracle Database PL/SQL Language Reference.
  • Oracle Technology Network "PL/SQL".
  • Oracle Tahiti.
  • ORACLE-BASE - Articles on Oracle PL/SQL.
• Oracle FAQs "PL/SQL".
• TAKTUM Informatik GmbH - "Oracle PL/SQL Tutorial: Oracle PL/SQL Tutorial - Die Programmiersprache von Oracle. Ein Nachschlagewerk auf Basis von Beispielen".
• EN.Wikipedia "PL/SQL", DE.Wikipedia "PL/SQL".

• IBM Knowledge Center "IBM Informix".
  • IBM Knowledge Center "SPL Functions".
• Database: IBM Informix.

• EN.Wikipedia "SQL/PSM".
• Databases:
  • IBM Db2.
  • MySQL, MariaDB.
  • PostgreSQL ( PostgreSQL PL/pgSQL ).
• PostgreSQL Wiki "SQL/PSM Manual"

• EN.Wikipedia "Transact SQL", DE.Wikipedia "Transact SQL".
• Database: Microsoft SQL Server.

• EN.Wikipedia "Stored procedure", DE.Wikipedia "Gespeicherte Prozedur".

• EN.Wikipedia "Common Object Request Broker Architecture", DE.Wikipedia "Common Object Request Broker Architecture".

• WebSQL → Chrome, Safari, Opera, Android Browser.
  • EN.Wikipedia "Web SQL Database".
• Indexed Database API, Index DB ( formerly: WebSimpleDB ) → Firefox, Chrome, MSIE.
  • EN.Wikipedia "Indexed Database API".

• EN.Wikipedia "Java Message Service", DE.Wikipedia "Java Message Service".

• Apache Axis - An implementation of SOAP (“Simple Object Access Protocol”).
• EN.Wikipedia "SOAP", DE.Wikipedia "SOAP".

• OpenDirectory "Top: Computers: Software: Databases".
• OpenDirectory "Top: World: Deutsch: Computer: Software: Datenbanken".
• OpenDirectory "Top: Computers: Data Formats: Markup Languages: XML: Tools: Editors"