How do I connect Visual Studio Connector to Wikipedia in 5 minutes?
Execute the following steps to connect Visual Studio Connector to Wikipedia. You only need knowledge of Visual Studio Connector, your own business and the Wikipedia administration.
Wikipedia is online software for encyclopedical knowledge. Wikipedia handles both the collection, sharing and maintenance of large volumes of encyclopedical knowledge across a wide range of languages.
No technical knowledge is needed nor knowledge on the Wikipedia APIs to connect Wikipedia to Visual Studio Connector. This step-by-step plan will tell you exactly which steps you need to go through on Invantive Cloud to create your own Azure data warehouse with data from Wikipedia.
The steps to connect Visual Studio Connector to Wikipedia are:
- Register an Invantive Cloud account.
- Create a Wikipedia database.
- Make the Wikipedia database available through the Microsoft OData connector.
- Connect Visual Studio Connector to Wikipedia through the connector.
- Load data from Wikipedia into Visual Studio Connector data warehouse.
Invantive Cloud offers a Wikipedia connector to download data from Wikipedia into Visual Studio Connector, but there are over 75 other connectors available also for SQL, Power BI Desktop, Power BI Service, Power Query and/or Azure Data Factory.
With the Wikipedia connector for Visual Studio Connector you will by default fetch the data from all connected Wikipedia companies in your dashboard. You can limit the number of Wikipedia companies that are retrieved in Visual Studio Connector through the Database settings. For example, you can also limit the connector for Visual Studio Connector to the data from exactly one Wikipedia company. Of course, you can also filter the data by a specific Wikipedia company using a filter step in Visual Studio Connector. The Wikipedia connector for Visual Studio Connector has advanced optimizations for great real-time performance with both a single Wikipedia company as well as with hundreds of Wikipedia companies.
When you are having questions, please check the forums for Wikipedia.
Register Account on Invantive Cloud
Skip this step when you already have an account on Invantive Cloud. Otherwise execute the following steps one time to register an account on Invantive Cloud:
-
Go to Invantive Cloud start page.
Select the Log on-button.
-
Select the Next-button.
-
Select the Next-button.
Enter your password and repeat the provided password.
You will receive a six-digit verification code by email within 2 minutes.
-
Select the Sign Up-button.
-
Log on now. >
-
Make sure you have an authentication app installed on your phone. Select the Next-button.
-
Add the displayed QR code to the authentication app, enter the current verification code, and choose "Finish".
-
The Invantive Cloud dashboard will be shown.
You now have a login code on Invantive Cloud with which you can set up the connection with Wikipedia and numerous other platforms. You will use the same Invantive login code and workflow for all other platforms.
Create Wikipedia database
In this step, we set up a database with data from Wikipedia. The database is "virtual" because it is not a traditional database, but is fed real-time from Wikipedia. Invantive Cloud provides Visual Studio Connector with a real-time link to Wikipedia. The database will be used for all your Wikipedia reporting with Visual Studio Connector. So you only need to perform these steps once.
-
Click the Add Database button.
-
Please fill out the form with login information for Wikipedia.
Select the OK-button.
Congratulations! You can now process data from Wikipedia within the Invantive Cloud website. You can do this for example with the interactive SQL editor.
Grant connection from Visual Studio Connector access to Wikipedia
To retrieve the data from Visual Studio Connector we create a link via Invantive Bridge Online. This creates a "bridge" between the cloud of Invantive and the standard OData connector that is available in every version of Visual Studio Connector. You do not need to install anything locally: no connector, no ado.NET provider and no Visual Studio Connector add-on neither.
Execute the following steps to safely use the data from Wikipedia outside of Invantive Cloud:
Next to the database you will find an orange text requesting you to allow access from your current location (IP address). Select the nearby orange button.
You must completely disable IP address checking by entering an asterisk ("*") since Microsoft Visual Studio Connector consists of hundreds of thousands of servers across the globe.
You are now ready to import the Wikipedia data into Visual Studio Connector.
Configure Visual Studio Connector connector for Wikipedia
You will now pull in Visual Studio Connector data from Wikipedia through the established link.
Please note again that Invantive Cloud under the hood handles all complexity such as setting up credentials such as a refresh token, acquiring an access token, optimizing and parallelizing access, accessing an API within the rate limits, scopes and security restrictions. There is absolutely no need for knowledge on complex technical topics such as OAuth access tokens or API. The Microsoft Azure Data Factory steps, activities and pipelines can be constructed using just the OData feed and basic authentication.
Execute the following steps:
-
Start Microsoft Visual Studio Connector and select 'Ingest'.
-
Enter in the window the Bridge Online URL of the Visual Studio Connector database. This URL containing the data can be found in the Database-form of Invantive Cloud. Choose authentication type 'Basic authentication'. Enter the Invantive Cloud user name and password.
-
The list of available Wikipedia tables appears. Select the desired tables and construct your pipeline in Microsoft Azure Data Factory.