Tools: Tech Talk - Revision history

ColinGreenstreet at 12:33, February 7, 2021

2021-02-07T12:33:16Z

ColinGreenstreet at 05:41, October 7, 2017

2017-10-07T05:41:39Z

ColinGreenstreet: /* Team three: visualisation of historical data */

2016-06-27T11:19:03Z

‎Team three: visualisation of historical data

ColinGreenstreet: /* Team three: visualisation of historical data */

2016-06-27T11:18:37Z

‎Team three: visualisation of historical data

ColinGreenstreet at 11:15, June 27, 2016

2016-06-27T11:15:05Z

ColinGreenstreet: /* Technology approaches available to three teams */

2016-06-27T11:10:00Z

‎Technology approaches available to three teams

ColinGreenstreet: Created page with "==Structure of the wiki== The MarineLives wiki is built on a PHP-based stack: - [https://www.mediawiki.org/wiki/MediaWiki Media Wiki] - [https://www.semantic-mediawiki.org/wi..."

2016-06-27T11:08:36Z

Created page with "==Structure of the wiki== The MarineLives wiki is built on a PHP-based stack: - [https://www.mediawiki.org/wiki/MediaWiki Media Wiki] - [https://www.semantic-mediawiki.org/wi..."

New page

==Structure of the wiki==

The MarineLives wiki is built on a PHP-based stack:
- [https://www.mediawiki.org/wiki/MediaWiki Media Wiki]
- [https://www.semantic-mediawiki.org/wiki/Semantic_MediaWiki Semantic MediaWiki] extension to allow storage and querying of data across pages
- [https://www.mediawiki.org/wiki/Extension:Semantic_Forms Semantic Forms] extension to allow editing of pages as structured data
- Custom extensions for folio navigation, basic transcription, and improved behaviour to match transcription expectations.
----
==History of the wiki==

The wiki was migrated from a collection of separate wikis; historically the wiki was set up with relatively unstructured data from one wiki site per volume of depositions (witness statements) and several further wikis for cross volume analysis. An importer took the data from each wiki and converted to structured data on a single wiki, with the analysis wikis moved to namespaced pages.
----
==Technology approaches available to three teams==

The three teams within the Digital Pop Up Lab will need different technology approaches:

===Team one: semi-automated recognition of handwritten manuscripts===

Rather than starting from scratch with a system like Tesseract which has problems with even handwriting, the recommended approach is to integrate with the [https://transkribus.eu/Transkribus/ Transkribus suite]. The base software is written in Java, and currently has a number of [https://github.com/transkribus/ client approaches in Java] together with a JS+ LAMP platform known as a Transcriptorium which uses the Transkribus web services.

===Team two: tailored and semantic search===

While it would be possible to build on top of exported data and use solutions such as graphql on top of that, the recommended initial approach is to explore search interfaces and data exploration built on top of the semantic mediawiki data interface. This would probably use a mix of PHP for any custom extensions and editing wiki pages to use the advanced Semantic MediaWiki syntax. See: https://www.semantic-mediawiki.org/wiki/Ask_API , https://www.semantic-mediawiki.org/wiki/Help:Selecting_pages , and https://www.semantic-mediawiki.org/wiki/Special:Ask)

===Team three: visualisation of historical data===

This team has the most flexibility in the tools to use in exploring the data. The data being visualised may come from custom data sets, or semantic/annotated data read live from the wiki using normal MediaWiki APIs, or more likely the Ask API from Semantic MediaWiki. Custom extensions presenting data transformed from internal APIs could also be used as a data source, but transformation and presentation after that could take many forms.

For an example of Ask API generated data output for further digital processing [http://www.marinelives.org/api.php?action=ask&query=[[Category:Pages]]%20[[Parent%20volume::HCA%2013/64]]%20OR%20[[Parent%20volume::HCA%2013/65]]&format=json click here].

@@ Line 5: / Line 5: @@
 Rowan Beentje is the designer of the MarineLives semantic media wiki and volunteer technical advisor to Digital Pop Up Lab. In his day job he works in mobile and web application development for a major media company.
-The article below, written by Rowan Beentke, describes the technology behind the MarineLives wiki.
+The article below, written by Rowan Beentje, describes the technology behind the MarineLives wiki.
 ----
 ==Structure of the wiki==

@@ Line 3: / Line 3: @@
 [[File:Rowan Beentje Tech Talk 27062016.PNG|600px|left|Rowan Beentje described technology behind the MarineLives wiki]]
-Rowan Beentje is the designer of the MarineLives semantic media wiki and volunteer technical advisor to Digital Pop Up Lab. In his day job he works in mobile an dweb application development for a major media company.
+Rowan Beentje is the designer of the MarineLives semantic media wiki and volunteer technical advisor to Digital Pop Up Lab. In his day job he works in mobile and web application development for a major media company.
 The article below, written by Rowan Beentke, describes the technology behind the MarineLives wiki.

@@ Line 33: / Line 33: @@
 ===Team three: visualisation of historical data===
-[[File:Ask Api Output 27062016.PNG|700px|thumb|right|Ask API generated output from MarineLives wiki]]
+[[File:Ask Api Output 27062016.PNG|700px|thumb|left|Ask API generated output from MarineLives wiki]]
 This team has the most flexibility in the tools to use in exploring the data. The data being visualised may come from custom data sets, or semantic/annotated data read live from the wiki using [https://www.mediawiki.org/wiki/API:Main_page normal MediaWiki APIs], or more likely the [https://www.semantic-mediawiki.org/wiki/Ask_API Ask API from Semantic MediaWiki]. Custom extensions presenting data transformed from internal APIs could also be used as a data source, but transformation and presentation after that could take many forms.
 For an example of Ask API generated data output for further digital processing see image.

@@ Line 32: / Line 32: @@
 ===Team three: visualisation of historical data===
 This team has the most flexibility in the tools to use in exploring the data. The data being visualised may come from custom data sets, or semantic/annotated data read live from the wiki using [https://www.mediawiki.org/wiki/API:Main_page normal MediaWiki APIs], or more likely the [https://www.semantic-mediawiki.org/wiki/Ask_API Ask API from Semantic MediaWiki]. Custom extensions presenting data transformed from internal APIs could also be used as a data source, but transformation and presentation after that could take many forms.
 For an example of Ask API generated data output for further digital processing see image.

← Older revision		Revision as of 11:15, June 27, 2016
Line 1:		Line 1:
		+	==Rowan Beentje==
		+
		+	[[File:Rowan Beentje Tech Talk 27062016.PNG\|600px\|left\|Rowan Beentje described technology behind the MarineLives wiki]]
		+
		+	Rowan Beentje is the designer of the MarineLives semantic media wiki and volunteer technical advisor to Digital Pop Up Lab. In his day job he works in mobile an dweb application development for a major media company.
		+
		+	The article below, written by Rowan Beentke, describes the technology behind the MarineLives wiki.
		+	----
	==Structure of the wiki==		==Structure of the wiki==