Is there any way to crawling marketplace.visualstudio.com

Question

As this title says, I want to get VS code Plugins' information Firstly, I need get the urls of Plugins Secondly, crawling every single Plugin's url to get more information, like it's Categories, and tags and Project Details and so on.

I tried, but failed in the first step. Or is there open API for us to get those information?

Answer 1

You have two choices available to you.

First: If you can host the javascript file somewhere remotely you can link it in the bottom of the post via the editor. The beauty of this is that you can update the js without having to update your main template.

For post edits you can select settings and choose HTML markup

then add a link to the script in the bottom of the page.

Or for a page edit it is the same concept you can switch to HTML markup and add it there.

Second: you can create a function in your template and then only fire it on the relevant post or page.

The way I have done this in the past is to get the post/page name from the file path, split the file path into an array and add them to the classnames for the html element. Example here:

const dom = document.querySelector('html');
const path = document.location.pathname.split('/');
const primaryDir = path[1]; // get the primary folder
const secondaryDir = path[2]; // get secondary folder
const tertiaryDir = path[3]; // get the tertiary folder

const setIndexPage = () => {
    if (!primaryDir) { // if there is no primaryDir we should assume we are on the home/index page
        dom.classList.add('index');
    } else if (tertiaryDir) {
        dom.classList.add(primaryDir + ' ' + secondaryDir + ' ' + tertiaryDir);
    } else if (secondaryDir) {
        dom.classList.add(primaryDir + ' ' + secondaryDir);
    } else {
        dom.classList.add(primaryDir);
    }
}

Now we can target our function to run only if it finds the correct selector

if (document.querySelector('.yourClassName').length) {
    // run your function here
}

For .yourClassName you need to pass in the page or post name. By default Tumblr will create a unique post id (integer) and add that to the filepath. But you can also use text/verbose file names in addition.

The beauty of this method, is that the classnames will be added to every page, but you can chose to target only certain posts/pages with your js function.

Alternatively you could use this method and add the html selector only to your post/page content. So wrap your content in a div and give that a unique id or classname, but the method is the same.

Here is an example of a page where I am doing this (although I am concatenating the class names slightly differently).

I hope this makes sense.