Wednesday, December 27, 2017

sysstat

https://github.com/sysstat/sysstat

http://sebastien.godard.pagesperso-orange.fr/

Storage Basics

http://vmtoday.com/2009/12/storage-basics-part-i-intro/

Monday, December 25, 2017

Reading list

strace

traceroute

linux sysAdmin guides: https://linux.die.net/sag/

linux cli tool summary https://linux.die.net/Linux-CLI/

linux documentation https://linux.die.net/


Thursday, November 30, 2017

DB2 PureScale on AWS?

According to IBM site (link-1, link-2), pureScale minimally needs
  1. the IBM General Parallel File System software to create the DB2 cluster file system on the shared disk;
  2. fast network connectivity (TCPIP allowed since 10.5.0.4 Cancun release).
Notice IBM recently rebranded GPFS to Spectrum Scale, which is conceptually deployable to AWS (ref.link), though fine prints may apply (eg. no encryption in ebs, not sure if this is a hard requirement, yet......)

Sounds like it's quite feasible to have pureScale on AWS? will give it a try.

Also, nice guide combing QRepl and across two pureScale clusters.

As for HADR across 2 pureScale clusters, many restrictions apply, with the most significant one being no ROS, followed by (NEAR)SYNC not supported, among many others listed here.

More on GPFS, or should i say spectrumScale, please refer to this link.

Saturday, November 25, 2017

HBase question dumps

Collection of random questions about HBase, for my own reference:


  • Why prefer JBOD over RAID for slave nodes? is it b/c of the underlying assumption of using HDFS? how does HDFS replicates blocks? is it possible that replication fails before a block get replicated? How to recover from such failure, from HDFS standpoint of view?
  • Not directly related to HBase, but what are the pros and cons of different fs mentioned in Chapter 2? (ext3,4, XFS, ZFS....)
  • RPC call between HBase and HDFS, assume version matches, performance concerns? 
  • Best practice on how to avoid memory swap, especially on slaveNode.

Friday, November 24, 2017

OS course dumps

CS194-24: Advanced Operating Systems Structures and Implementation @ Berkeley link


hmmmm, should i give it a try?
http://zh4ui.net/post/2017-09-04-aws-certifications/

learning HBase - init

Started learning HBase today, following The Definitive Guide. This series logs my progress.

Would be great if it helps people with limited background to navigate through all the obstacles and enjoy HBase.

Day 0
  • Install/Set up git:
    • folk https://github.com/larsgeorge/hbase-book
    • ref-1 Getting-Started-First-Time-Git-Setup link
  • Install Maven:
    • sudo apt-get install maven
    • ref-1 maven-in-five-minutes link

Day 1
  • hbase site e-book (ref. link)
  • webUI port changed from 60010 to 16010 !