Three Cheers for Software RAID

Last year, I built a NAS machine as referenced by my previous post here. This month, my media drive composed of an LVM logical volume of almost 5TB is almost filled.

This drive contains all purchased media and our home videos for Plex, as well as our time machine backups. To alleviate the storage shortage, I purchased two 4TB Western Digital WD40EFRX hard drives. This weekend I took the plunge and installed the two new drives into my NAS computer. In the spirit of the moment, without performing a backup, I proceeded to:

  • Use parted to partition the drives;
  • Use mdadm to create a RAID 1 device of the two drives;
  • Created a new LVM physical volume with the new RAID device;
  • Added the volume to the existing volume group;
  • Extend the logical volume to newly added 4TB;
  • and finally, Extend the ext4 file system to include the 4TB

In the end, I now have a near 9TB network drive that should last me for quite sometime.

In researching how to extend the logical volume, I also found out how I can upgrade my drives in my existing physical volumes to higher capacity drives without having to recopy everything to another drive first. This should come in handy in the future, because my NAS computer box has no more drive bays.

I know I probably should have taken a backup before this, but everything worked and I couldn’t be happier. Hurray, hurray, and hurray for software RAID.

Thank you Gigabyte and Western Digital

This morning I upgraded my media server. The server was running on a seven years old motherboard, Gigabyte GA-M61PME-S2P, and an AMD Athlon II X2 245 processor. The hard drive is the oldest, a Western Digital WDC WD800JB-00JJ 80GB hard drive that was released back in 2007. This makes the drive 9 years old! At the time of this update, all systems were nominal and operating without issues. Running Ubuntu 16.04.1 LTS (Xenial Xerus), next to my iMac, it was the lowest maintenance box I’ve ever put together.

The real reason for the upgrade is for me to reduce the power footprint of a box that is effectively running 7×24. Even when it was idling, the old components where clocking in at 100+ W of power usage.

I decided to replace the motherboard and cpu with an ASRock AM1H-ITX and a system on a chip AMD Athlon 5350 APU. I was able to get the system down to 55W. I also replaced the old WD800JB with a Seagate BarraCuda 7200.10 ST3500630AS 500GB hard drive, along with the existing 4 WD Green EZRX hard drives. A total of 5 traditional mechanical hard drives. Along with new Kingston HyperX Fury Black 8GB memory, this entire upgrade cost less than $220 CAD with taxes included.

I want to shoutout to Clonezilla. What an amazing job they did in creating a super simple piece of software to clone drives and partitions. Of course Linux is just so wonderful to work with. After changing the CPU and Motherboard, the original Ubuntu installation boot up and run without any major issues. The only wrinkle I had was the ethernet port that came with the new motherboard had a new logical name (enp3s0 vs eth0). Luckily, I know how to fix that. My LVM volume assembled without a hitch. Everything is now running fine with the new hardware and configuration.

My next step in the coming months is to shop for a 500GB SSD. Perhaps I can find one during Cyber Monday or Black Friday sales. This should further reduce my power footprint and also increase my performance.

AI & Our Future Generations

When I came into the workforce in the early 90’s, any career connected to the computer was hot. The Internet was at its infancy. Any two or more (often just two) computers connected was called a network, which was a huge deal. Believe it or not email was the killer app. The World Wide Web was not invented yet, and when it came into the scene, finding a photo on a web page was a big deal.

My young and arrogant mind was extremely happy with myself, since I was all ready to take on the world with an engineering degree specializing in computers. It was a fearless time. We called the shots, not the employers. Our salaries increase astronomically, often with accompanying perks. We could do no wrong, because we were in demand.

I remember reading an article about our company’s solution. The solution was installed at a food and beverage manufacturer, who recently announced a significant layoff caused by the application of our software. Our customer was happy, because we saved them a tremendous amount of costs. I thought that anyone who picked a career in a job involving repetitive tasks will be in trouble. Cashiers, banking tellers, and warehouse pickers are a few that comes to mind.

We were all too eager to implement algorithms and solutions to turn repeatable tasks into optimal applications running on computers. We as a profession were clear and present danger to people’s livelihood who were dependent on honest jobs that are replaceable by robotics, advance supply chains, automated warehouses, or just simply better data visibility and communication. On reflection, I was / am part of a group that is undermining the economic value of a human being in a capitalist economy. People that are displaced are forced to upgrade and migrate their skills to other areas that are still in demand.

With artificial intelligence (AI) and machine learning coming into the consumer and business market in a big way, I am led to believe that the next set of jobs, jobs requiring judgement and decision making are now potentially replaceable by AI technology. Even software developer jobs may be under threat, when you have technologies like Viv that fulfills a human vocal request by manufacturing a custom program. I fear that replacement of traditional professions like lawyers and doctors are not too far away when IBM Watson can now perform medical diagnosis. How will these displaced professionals upgrade their skills?

In today’s news, one can frequently find mentions of self driving cars. How they are on the cusp of mass market availability and adoption. Companies like Tesla, Apple, and Uber are all either actively implementing production quality solutions or developing them. Imagine all the UPS, Fedex, freight truck and taxi drivers that will be displaced. The disruption does not stop there. If the technology is as successful as advocates tout it to be, then accident rates will drop. The transition from human to driverless solutions can translate to a large decline in automotive body shop business, and potential insurance revenue impact.

You can make arguments that displaced drivers will find other types of work, but I fear that under the current, exponential improvement of AI technology, the total some of human demand in the economy will continue to diminish, because AI will be so good that you will be hard pressed to find a job that AI cannot perform. So whenever you have an over supply of humans and a dwindling demand of their usability, you get erosion of the economic value of human beings.

So what’s wrong with this picture? Is it not good that AI capable machines pamper us and do all the hard work and thinking?

Assuming that we continue to function in a market based society, my immediate concern is, how does the next generation make their income when their economic value is eroded to the point where there may not be any jobs left. Well, I suppose there are jobs that involve creativity and innovation, such as artists, and musicians. From another hopeful perspective, this may resolve itself since providers, even if they are machine run, must find matching buyers with enough spending power to buy their products and services.

My second concern is, as a species, how do we continue to excel in our own knowledge and achievements, when AI can solve most of our problems. You can probably find some evidence of this today, with the usage of Google and other specialized search engines. I am not sure that the current education system are raising deep thinkers complemented by these new AI based tools, or more academically hampered ones because of the same tools.

Lastly, there is the Matrix or Terminator scenario, but the difference is that it may not be a violent take over. It could be a slow transition, as we welcome these technologies as new found creature comforts. A gradual displacement of our economic worth and values, until we are all powerless with our machine overlords. Or if you believe in Ray Kurzweil’s singularity, we can be in a symbiotic, and harmonious relationship with the AI machines.

Please tell me that my fear for our future generations are unfounded.

 

Google Adopts Apple Combine Hardware and Software Philosophy

Google held an event earlier today and introduced a suite of new hardware:

  • A phone called Pixel that works with Daydream their new VR headset;
  • Google WiFi router;
  • And an Amazon Echo like device called Google Home, that will work seamlessly with existing Chromecast devices

Google Assistant is the culmination of Google’s software strength in the area of search and machine learning. The event is peppered with a plethora of examples on how your daily life will be improved and facilitated by the Google Assistant through the use of Google’s new hardware. The hardware and software combination makes for a compelling and attractive offering to join the Google ecosystem.

I think Google is finally seeing the light of Apple’s philosophy of building solutions with full control of both hardware and software design. Apple still has two other areas where Google is still lacking:

  • A retail presence with a second to none personable support experience;
  • And its devotion and practice in personal privacy

It will be interesting to see if a future Google will make ways to close the remaining gaps. Of course, I’m also worried about how Google will serve you ads through these devices once they’ve trapped you into their ecosystem.