It looks like York Region is beginning to ramp up our vaccine schedules. We are now awaiting our postal code to be eligible so that my wife and I can make an appointment. At the time of writing this post, unfortunately, our postal code is still not eligible.<\/p>\n\n\n\n
We know some of our neighbours are checking the website, https:\/\/york.ca\/covid19vaccine<\/a> on a regular basis. Obviously, this is very tedious and frustrating. I decided to embark on a small project to detect our postal code from the web site. My goal is to write a script that can be executed from my NAS server every 30 minutes to see if it can find our postal code on the website. My first attempt was to use Python and Selenium<\/a>. The API was a bit clunky and I found it to be somewhat unreliable and fraught with timing issues. I gave up on this approach.<\/p>\n\n\n\n I thought I give it another shot, but this time using Puppeteer<\/a>. This was much more simpler to use, and I found it to be more friendly especially if you’ve worked with Browser based Javascript to begin with.<\/p>\n\n\n\n I wrote this simple I placed this script in the directory Before I run the program, I had to install Running the above Of course will be in the output.<\/p>\n\n\n\n I supplemented the above with a shell script program which I can later use to configure cron to be executed every 30 minutes. The shell script’s job is to monitor the website using I could have included the email notification logic in the node script as well, but I figure I may want to check manually on an infrequent basis, in which case I simply run the Now all there is to be done is relax and wait, a thing that we have been doing a lot lately during the pandemic.<\/p>\n","protected":false},"excerpt":{"rendered":" It looks like York Region is beginning to ramp up our vaccine schedules. We are now awaiting our postal code to be eligible so that my wife and I can make an appointment. At the time of writing this post, unfortunately, our postal code is still not eligible. We know some of our neighbours are … Continue reading “Checking for Vaccine Schedule Availability”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1317","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p7V6i8-lf","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/posts\/1317","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/comments?post=1317"}],"version-history":[{"count":10,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/posts\/1317\/revisions"}],"predecessor-version":[{"id":1329,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/posts\/1317\/revisions\/1329"}],"wp:attachment":[{"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/media?parent=1317"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/categories?post=1317"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.lufamily.ca\/kang\/wp-json\/wp\/v2\/tags?post=1317"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}node<\/code> script called scrape.js<\/code>:<\/p>\n\n\n\n#!\/usr\/bin\/env node\n\nconst puppeteer = require('puppeteer');\n\nconst targetPostalCode = process.argv[2] || 'A2B';\n\nconsole.log ('scraping for ' + targetPostalCode + '...\\n');\n\n(async () => {\n const browser = await puppeteer.launch();\n const page = await browser.newPage();\n await page.goto('http:\/\/york.ca\/covid19vaccine');\n\n const anchorSelector = 'div#Y_accor div.new h3.Y_accordion span.trigger a';\n await page.waitForSelector(anchorSelector);\n\n console.log ('received...\\n');\n\n const result = await page.evaluate((anchorSelector) => {\n let res = [];\n document.querySelectorAll(anchorSelector).forEach(function(elem){\n if (elem.textContent.match(\/.*50 Years of Age and Older.*\/i) != null) {\n elem.parentElement.parentElement.parentElement.querySelectorAll("p").forEach(function(elem){\n if (elem.textContent.match(\/.*postal codes.*\/i) != null) { \n const postalCodes = elem.parentElement.querySelector("strong").textContent;\n postalCodes.split(", ").forEach(function(pc) {\n res.push(pc.trim());\n });\n }\n });\n }\n });\n return res;\n }, anchorSelector);\n\n console.log(result);\n\n let found = false;\n let regex = new RegExp(targetPostalCode, "i");\n result.forEach(function(postalCode) {\n if (postalCode.match(regex) != null) {\n \/\/ Postal Code Found!\n console.log("We found: " + targetPostalCode);\n found = true;\n }\n });\n\n console.log('closing...');\n\n await browser.close();\n})();\n<\/pre><\/div>\n\n\n\/home\/xxxxx\/gitwork\/covidMonitor<\/code>. Note that I targeted “50 years of Age and Older<\/strong>“, because this is the age group that I am personally interested in. The A2B <\/code>is also not my real postal code. It is used instead of my own private postal code.<\/p>\n\n\n\npuppeteer<\/code> in my working directory. <\/p>\n\n\n\ncd \/home\/xxxxx\/gitwork\/covidMonitor\nsudo npm i puppeteer<\/pre>\n\n\n\n
scrape.js<\/code> produces the following:<\/p>\n\n\n\nscraping for A2B...\n\nreceived...\n\n[ 'L0J',\n 'L4B',\n 'L4E',\n 'L4H',\n 'L4J',\n 'L4K',\n 'L4L',\n 'L6A',\n 'L3S',\n 'L3T',\n 'L6B',\n 'L6C',\n 'L6E' ]\nclosing. \n<\/pre><\/div>\n\n\n
A2B<\/code> is not in the list. If it was, another line like:<\/p>\n\n\n\nWe found: A2B\n<\/pre><\/div>\n\n\n
scrape.js<\/code> and if the postal code is found, then send a notification email.<\/p>\n\n\n\n#!\/usr\/bin\/env zsh\n\ncd \/home\/xxxxx\/gitwork\/covidMonitor\n\nif [ $(.\/scrape.js | tee \/home\/xxxxx\/log\/covidPostalCodes.log | grep "found" | wc -l) -ge 1 ]\nthen\n\nsendmail xxxxx@gmail.com <<@\nSubject: Covid Vaccine Can Be Scheduled\n\nGoto the following site to schedule your vaccine:\n\nhttps:\/\/york.ca\/covid19vaccine\n\n@\n\nfi\n<\/pre><\/div>\n\n\n
scrape.js<\/code> script on the command line.<\/p>\n\n\n\n