Url categorization and contextual service -- 2

URL categorization and context service: - We have a browser extension which captures the url a user goes to and associates that URL to that user in our database. We need to build a service which can then go to that URL and associate a category ( IAB) to that page plus the most relevant contextual keywords from the page. - understand what IAB category that page belongs to and what the context of the page is. - Create a service which returns that information to our google cloud instance. - It should check to see if we have already indexed that full url in the last 24 hours and if so then don't hit the api again until we feel its been updated. - Additionally if a page requires login (for example I'm on my gmail account and i pass this url ( [login to view URL] ) it would only return the login page. - For URLs such as that we should capture and cache those and create a blacklist of urls that we can't track and not spend computing time requesting information about that page. An example of a service is [login to view URL] , who currently does this quite well but in a different use case is Grapeshot. [login to view URL] Once that data is returned it needs associated with that user. To be considered for the project please provide the following: - Previous experience with building a service like this including a description of how you would categorize the following URLS and the context of these urls: [login to view URL] [login to view URL]:05LwSaS2MHInHOW-Rs0176K5008moVJUp1Y2f1AXRz5B0NWcvAb37etl5kZqAboFPCdT7dzanbkkUxs0Pth3O5t_CTHSFAoq2JdOADo8N8Len3Dg_5QSXGL5LIypZGEQ5x5SHyOI0e4tHrIAU7mCX_dwajaBoGmazaJ6qmbBpfLovUdoZXRDkYwyVzQfEQbo4t1OCtD9WKsGqRyfP49k9w&wpa_tag=&wpa_aux_info=&wpa_pos=1&wpa_plmt=1145x1145_T-C-IG_TI_1-6_HL-INGRID-GRID-NY&wpa_aduid=10b9ed54-e10a-4571-a621-ff463fa6f24d&wpa_pg=browse&wpa_pg_id=3944_1060825_1229815_1229823&wpa_st=OLED%2BTVs&wpa_tax=3944_1060825_1229815_1229823&wpa_bucket=__bkt__ -