Reading Time: < 1 minute (Update 12-10-2020) Ran the DataFusionQuickstart from Data Fusion Hub. Need to make sure the compute@developer service account have the following roles: BigQuery AdminCloud Data Fusion RunnerDataproc WorkerService Account UserStorage Admin then the datafusion user service account still has “Service Account User” role (this is same as below). The big query and storage roles are needed… Continue reading GCP Data Fusion
Terraform
Reading Time: < 1 minute Doing Prepare for Certification Get Started – AWS : below has some issues, cannot find the image. Note I tried to find correct ami image id too (ami-032930428bf1abbff, via AWS console), but it appears there is another issue when a correct ami image id was used. *Amazon Linux AMI 2018.03.0 (HVM), SSD Volume Type –… Continue reading Terraform
hosts file for productivity
Reading Time: < 1 minute Sometimes we need to get something done without the distraction of facebook, twitter or for that matter, linkedin (or some other sites you want to stay away). Here is a tip for how to do it on Mac. sudo vi /etc/hosts(note you don’t have to use vi, feel free to use nano or other editor… Continue reading hosts file for productivity
WeChat is not banned, at least not yet
Reading Time: 2 minutes (Update 09-20-2020) It looks like the 9th court temporarily blocked the WeChat ban (NPR). The TikTok ban became irrelevant because there is the new deal with Oracle / Walmart (theverge). (Original 09-18-2020) CNN: US will ban WeChat and TikTok downloads on Sunday. Quote: “The only real change as of Sunday night will be [TikTok users]… Continue reading WeChat is not banned, at least not yet
Virtual Learning
Reading Time: < 1 minute I normally use google calendar for kiddos’ Zoom meetings. My older daughter who is going to be FGC dragon knows get to Zoom via Google classroom. I can train her on the google calendar too. But now I am thinking I will take Monday off for the full time support of virtual learning (I feel… Continue reading Virtual Learning
API Gateway
Reading Time: < 1 minute Kong Kong is a cloud-native, fast, scalable, and distributed Microservice Abstraction Layer (also known as an API Gateway or API Middleware). Made available as an open-source project in 2015, its core values are high performance and extensibility. Actively maintained, Kong is widely used in production at companies ranging from startups to Global 5000 as well as… Continue reading API Gateway
Spring batch, Spring Scheduler, PCF
Reading Time: < 1 minute Was experimenting running scheduled job on PCF. One natural choice is PCF scheduler, which comes with the Pivotal Web Services (PAAS). Googled around and found this example on DZone. The spring batch code is here. There was a small typo in the manifest.yaml, path: build/libs/payment-processing-spring-batch-0.0.1-SNAPSHOT.jar Note the snapshot.jar file name does not match what’s specified… Continue reading Spring batch, Spring Scheduler, PCF
GCP Cloud Storage and PCF
Reading Time: < 1 minute Tried two two tutorials on my personal GCP. hello world cloud storage (upload a file, then return a public url for download; another download link) I may delete those bucket and files later on, as hosting costs money (app engine, cloud storage). Update: I disabled the app (here is one article talking about disable /… Continue reading GCP Cloud Storage and PCF
How to generate a Lets encrypt SSL cert
Reading Time: < 1 minute I followed the instruction here https://certbot.eff.org to get a free SSL cert for my website: (pretty cool, huh 🙂 (found it here) To actually do it, I just go to the website: Scroll down a little, select the software and the system my website is running on, and it will generate all the command-lines for… Continue reading How to generate a Lets encrypt SSL cert
Couple agile tools
Reading Time: < 1 minute Point Poker: free (accepts donation). A nice pointing tool, click start session, for collaborators: put in name, and join the session. Fun Retro: there are free and non-free choices. The free ones are public. It’s a bit like Trello. For that matter, if someone likes to keep it private, I think Trello is a good… Continue reading Couple agile tools