GZIP

To test if the file is proper .gz file and  is not corrupted use:

gzip -t <gzipped_file_name>

Comments

Post a Comment

Popular posts from this blog

Java Encryption/Decryption

Java does not always throw exception while decoding a text using different key than the one used for encoding it. Though the decoded text will be garbage. So dont rely on throwing exception if the key is incorrect. Character.getType(character) returns a in value which stands for a category to which character belongs. esp. the value returned as 28 stands for OTHER_SYMBOLS and it is normally non-printable junk characters.
Read more

Transactions in HIVE

Full ACID  semantics at row level is supported since HIVE  0.13.  Earlier it was only supported at partition level.   Atomicity: Entire operation is single operation. Either entire operation happens or none. Consistency: Once an operation is completed, every subsequent operations sees the same result of it.  Isolation: One user operation does not impact another user.  Durability: Once operation is done ..its result remains thereafter. At present isolation is only at snapshot level. There are following isolation levels in various DBMS: Snapshot: The snapshot of data at the beginning of  transaction will be visible to through out the transaction. Whatever is happening in other transaction will never be seen by this transaction.  Dirty Read: Uncommitted updates from other transactions can be seen. Read Committed: Only updates which are committed at the time of read will be seen by this transaction. Repeatable Read: Read lock on data being read a...
Read more

UNIX/LINUX

1. Use Ctrl+D for specifying EOF for stdin. 2. Removing the files returned by svn status command. svn status | awk '{cmd = "rm " $2; system(cmd)}' 3. To find the Linux distribution on the machine more /etc/*-release 4.  top, htop, iotop,sysstat  for seeing the system usage. 5.  jstack   for seeing the threads inside a java process 6. In LDAP access log , to print all the lines which has etimes greater than 10 ms and also print next line if it has "SRCH" into it, use following command awk -F= '/etime/ && $7>0.02000 {print FNR; print;getline; print FNR;if (match($0,"SRCH")) {print}}'  access 6.1  To list all the lines which have etime > 1000 ms   awk -F"etime=" '$2>1000 {print }' access 7.  In LDAP access log, print the previous line and the line where etimes greater than 10 ms. awk -F= '/etime/ && $7>0.01000 { print line;print;} {line=$0}'  access 8. Su...
Read more