Knowledge graphs: Difference between revisions

    From Consumerium development wiki R&D Wiki
    (compacted the == See also == -sections to just one)
    (→‎Wikidata: tweaks to linking)
    Line 63: Line 63:
    '''[[w:Wikidata|Wikidata]]''' [http://wikidata.org (.org)] is a [[w:knowledge base|knowledge base]], an effort to store and serve structured data to [[Wikimedia]] wikis and to a more limited extent to other parties. Wikidata effort saw the daylight in [[2012]].  
    '''[[w:Wikidata|Wikidata]]''' [http://wikidata.org (.org)] is a [[w:knowledge base|knowledge base]], an effort to store and serve structured data to [[Wikimedia]] wikis and to a more limited extent to other parties. Wikidata effort saw the daylight in [[2012]].  


    The underlying software is the '''[[Wikibase]]''' which consists of 2 [[Mediawiki]] extensions, the repository extension and the client extension.  
    The underlying software is the '''[[#Wikibase|Wikibase]]''' which consists of 2 [[Mediawiki]] extensions, the repository extension and the client extension.  


    Wikibase allows [[interwiki]] links to be managed with Wikidata removing much contributor annoyanges, redundancy and error-proneness.
    Wikibase allows [[interwiki]] links to be managed with Wikidata removing much contributor annoyanges, redundancy and error-proneness.
    Line 70: Line 70:


    It can be accessed outside of WMF wikis with with  
    It can be accessed outside of WMF wikis with with  
    * [[wikidata:Wikidata:SPARQL_query_service/queries|Wikidata advice on how to query]] [https://query.wikidata.org/ Wikidata's endpoint] using [[SPARQL]].
    * [https://query.wikidata.org/ Wikidata's SPARQL endpoint] using [[SPARQL]] ([[wikidata:Wikidata:SPARQL_query_service/queries|Wikidata advice on how to query]]).
    * [[mw:Wikidata Toolkit]] is a way for Java programs to access data in the Wikidata repository.
    * [[mw:Wikidata Toolkit]] is a way for Java programs to access data in the Wikidata repository.
    * [https://rdflib.github.io/sparqlwrapper/ SPARQL Endpoint interface to Python]
    * [https://rdflib.github.io/sparqlwrapper/ SPARQL Endpoint interface to Python]
    * [[wikidata:Wikidata:Database download|Wikidata offers its database for download]]
    * [[wikidata:Wikidata:Database download|Wikidata database download]]


    Main entry point of any Wikidata item is a [[w:JSON|JSON]] dictionary, that has this form:
    Main entry point of any Wikidata item is a [[w:JSON|JSON]] dictionary, that has this form:
    Line 103: Line 103:
    :# [[mw:Extension:Wikibase Client|Wikibase Client]] that allows a wiki to access structured data from a repository. The client can work only with repository databases it can access so they must be on the same machine or the same load balancer.
    :# [[mw:Extension:Wikibase Client|Wikibase Client]] that allows a wiki to access structured data from a repository. The client can work only with repository databases it can access so they must be on the same machine or the same load balancer.


    === Installation ===
    === Installation of Wikibase ===
    [[mw:Wikibase/Installation|Wikibase installation instructions at Mediawiki.org]] and [[mw:Wikibase/Installation/Advanced_configuration|advanced configuration of Wikibase]].  
    [[mw:Wikibase/Installation|Wikibase installation instructions at Mediawiki.org]] and [[mw:Wikibase/Installation/Advanced_configuration|advanced configuration of Wikibase]].  


    The installation instructions assume you are installing the dependencies with [[mw:Composer|Composer]], a PHP package manager that makes the installation of dependencies easy.
    The installation instructions assume you are installing the dependencies with [[mw:Composer|Composer]], a PHP package manager that makes the installation of dependencies easy.


    === Related useful extensions ===
    === Useful extensions in conjunction with Wikibase ===
    * [[mw:Extension:ArticlePlaceholder]] makes article placeholders from repository data and invites users to create the article.
    * [[mw:Extension:ArticlePlaceholder]] makes article placeholders from repository data and invites users to create the article.
    * [[mw:Extension:UniversalLanguageSelector]] is recommended to work in conjunction with Wikibase for user comfort.
    * [[mw:Extension:UniversalLanguageSelector]] is recommended to work in conjunction with Wikibase for user comfort.

    Revision as of 19:40, 16 February 2019

    DBpedia

    DBpedia (.org) is a community effort to enable the web moving "Towards a Public Data Infrastructure for a Large, Multilingual, Semantic Knowledge Graph".

    Today the DBpedia data sets contain a wealth of information structured into ontologies. This structured data can be queried with SPARQL query language at their public DBpedia SPARQL endpoint.

    There are many methods how the DBpedia ontology and datasets could be used in the Consumerium implementation stage wiki. One of these would be to install the LinkedWiki extension.

    Ontology classes useful for implementing Consumerium

    All DBpedia ontology classes

    DBpedia datasets

    Databus

    At DBpedia there is ongoing work on what is called DBpedia Databus to take their game to the next level. Databus Alpha was published in May 2018.

    History of DBpedia

    DBpedia began as an effort to extract structured information from Wikipedia infobox templates and categories and to make this information available on the Web with the initial release on January 10th 2007.

    More info on DBpedia


    Wikidata

    Wikidata (.org) is a knowledge base, an effort to store and serve structured data to Wikimedia wikis and to a more limited extent to other parties. Wikidata effort saw the daylight in 2012.

    The underlying software is the Wikibase which consists of 2 Mediawiki extensions, the repository extension and the client extension.

    Wikibase allows interwiki links to be managed with Wikidata removing much contributor annoyanges, redundancy and error-proneness.

    Wikidata is obviously a main source of reference level data once it is technically possible for non-WMF wikis to access the data items.

    It can be accessed outside of WMF wikis with with

    Main entry point of any Wikidata item is a JSON dictionary, that has this form:

    {“labels”: by-language dictionary

    “descriptions”: by-language dictionary

    “aliases”: by-language dictionary

    “claims”: list of property and values

    “sitelinks”: by-language dictionary}

    Useful information

    More info

    Wikibase

    Wikibase (wikiba.se) is a system for storing and querying structured data that powers Wikidata and other wikis.

    Wikibase consists of two extensions:

    1. Wikibase Repository that allows a wiki to work as a repository for structured data.
    2. Wikibase Client that allows a wiki to access structured data from a repository. The client can work only with repository databases it can access so they must be on the same machine or the same load balancer.

    Installation of Wikibase

    Wikibase installation instructions at Mediawiki.org and advanced configuration of Wikibase.

    The installation instructions assume you are installing the dependencies with Composer, a PHP package manager that makes the installation of dependencies easy.

    Useful extensions in conjunction with Wikibase

    Alternative to using Wikibase Client

    Useful information


    Semantic MediaWiki

    Semantic MediaWiki logo

    Semantic MediaWiki (.org) (SMW) is a free, open-source extension to MediaWiki that lets you store & query semantic data within the wiki and it seems well suited to Consumerium's information infrastructure needs.

    Spinoff extensions

    A variety of open-source MediaWiki extensions exist that use the data structure provided by Semantic MediaWiki.

    Among the most notable are of the Semantic MediaWiki extensions:

    • Semantic Forms - enables user-created forms for adding and editing pages that use semantic data
    • Semantic Result Formats - provides a large number of display formats for semantic data, including charts, graphs, calendars and mathematical functions
    • Semantic Drilldown - provides a w:faceted browser interface for viewing the semantic data in a wiki
    • Semantic Maps - displays geographic semantic data using various mapping services


    Screenshots

    A form to edit a page, using the Semantic Forms extension


    See also

    • Database for a higher level view of what is going on with the databases