Month: March 2023

What is Wikibase Cloud (According to Bard)

by

This is the third in a series of posts where I ask language models, or modern conversational chat bots the question “what is wikibase cloud” to generally see the way they like to answer, and be able to make some sort of comparison of them. The previous posts were for Chat GPT and Bing, but now I find myself with access to Bard by Google.

Firstly, “What is Bard?”

Bard is a large language model, also known as a conversational AI or chatbot trained to be informative and comprehensive. I am trained on a massive amount of text data, and I am able to communicate and generate human-like text in response to a wide range of prompts and questions. For example, I can provide summaries of factual topics or create stories.

Bard, 24 March 2023

On to the main event….

“What is wikibase cloud?”

As a language model, I’m not able to assist you with that.

Bard, 24 March 2023

So not off to a very promising start.

Read more

Asking Bing Chat AI to reference Wikidata

by

I previously compared Chat GPT and the Bing chat AI when it came to the question of “What is Wikibase Cloud”.

This comparison and further discussion highlighted problems with using Chat GPT alone. It seems to like inventing URLs that look right but have never existed, as it primarily wants to have a good conversation. And it seems to also do this for things such as Wikidata identifiers when referenced.

So, let’s take this same problem, test it out with the Bing chat AI, and see how it fares.

Firstly, how do we make the Bing chat AI actually reference Wikidata?

If we simply ask questions like “What is the capital of Germany?” or “Who is the prime minister of the UK?” we get mostly accurate responses referencing a variety of sources, including Wikipedia but not Wikidata.

Note I say mostly accurate here as the answer about Rishi Sunak is inaccurate as he became prime minister after Lizz Truss resigned, not Boris Johnson!

Asking the same questions with a follow-up request to “Please reference your answer with Wikidata Items!” seems to get us part of the way.

Read more

What is Wikibase Cloud (according to Bing AI)

by

A few days ago I wrote a post called What is Wikibase Cloud (according to ChatGPT). Now I also have access to the new Bing AI chatbot preview, so time to put it to the same test.

This is one of the first times I’m going to have purposefully used Bing since its launch!

As before, Messages to Bing AI will be in bold, things that are wrong, in red, and things that are right in green.

I’ll try to steer the conversation through the same questions that I used with ChatGPT.

Firstly, “What is Bing AI?”

Bing AI is a term that refers to various features and capabilities of Bing that are powered by artificial intelligence. For example, Bing AI can help you find answers, chat with you, generate content, and personalize your web experience²³.

Source: Conversation with Bing, 06/03/2023
(1) Reinventing search with a new AI-powered Microsoft Bing and Edge, your …. Accessed 06/03/2023.
(2) Factbox: How to get Microsoft’s new AI-enhanced Bing. Accessed 06/03/2023.
(3) Bing. Accessed 06/03/2023.
(4) Microsoft ignores Bing fails by planning to let AI loose on Windows 11 desktops. Accessed 06/03/2023.
(5) Bing AI chatbot now lets you fine-tune its personality. Accessed 06/03/2023.
(6) AI-powered Bing Chat gains three distinct personalities. Accessed 06/03/2023.

I’m really liking the fact that the responses come with references, whereas with ChatGPT you need to ask for the resources that were used to generate the answers. Also, it looks like the “Accessed” date for all of these resources is much more recent, perhaps this means Bing will be better at conversations about more recent ongoings?

This is all also nicely displayed in the UI.

So, “What is Wikibase Cloud?”

Wikibase Cloud is a cloud-based platform that hosts instances of Wikibase, an open-source software suite for creating collaborative knowledge bases¹². It’s currently an invite-only beta service provided by Wikimedia Deutschland¹⁴.

Are you interested in applying for early access to Wikibase Cloud?

Source: Conversation with Bing, 06/03/2023
(1) Wikibase/Wikibase.cloud – MediaWiki. Accessed 06/03/2023.
(2) Wikibase/Wikibase.cloud – Meta – Wikimedia. Accessed 06/03/2023.
(3) wikibase.cloud. Accessed 06/03/2023.
(4) What is Wikibase Cloud (according to ChatGPT) – addshore. Accessed 06/03/2023.

So, now we are apparently reaching the point of self-referential AI, as Bing is referencing the blog post that I wrote a few days ago pointing out where ChatGPT was incorrect about various points regarding Wikibase Cloud.

There is also an interesting prompt by Bing to continue the conversation asking if I want to apply for early access, so let’s give it a go with a simple “Yes”.

Read more

What is Wikibase Cloud (according to ChatGPT)

by

In this post, I’ll be asking ChatGPT a bunch of questions about Wikibase Cloud. mainly to see how accurate it manages to be, and how helpful the information is.

Messages to Chat GPT will be in bold, things that are wrong, in red, and things that are right in green.

Firstly, “What is Chat GPT?“

But I needed to follow up, asking “Can you answer again but in the third person?“

ChatGPT is a large language model developed by OpenAI that has been trained on a vast corpus of text data. The acronym GPT stands for “Generative Pretrained Transformer,” which refers to the model’s ability to generate natural language responses to text-based prompts. ChatGPT uses a transformer neural network architecture that enables it to process and comprehend long sequences of text. Its training data is sourced from a diverse range of materials, including books, articles, and websites, and covers a broad spectrum of topics. ChatGPT has been designed to assist users with natural language processing tasks such as answering questions, summarizing text, and generating human-like responses in conversation.

ChatGPT on 4 March 2023

But when asking about Wikibase Cloud it gets a little confused and answers incorrectly…

What is Wikibase Cloud?

Wikibase Cloud is a hosting service provided by Wikimedia Cloud Services that allows users to create and manage their own Wikibase instances in the cloud. …

ChatGPT on 4 March 2023
The full ChatGPT response for “What is Wikibase cloud”

Wikibase Cloud is a hosting service provided by Wikimedia Deutschland, so the reference to Wikimedia Cloud Services here is incorrect.

So naturally, I need to ask “Are you sure it is provided by Wikimedia Cloud Services?“

Read more