DOS BATCH SCRIPTS

1. Had to frequently pull files from a server. The file set  used to be in following format.

abc123_file1.txt
def23145_file2.txt
r4rtyyy_file3.txt

The task was to remove the prefix from names and put the file set back. It was too mechanical, so I wrote following script to do the same.


ECHO OFF

 SETLOCAL EnableDelayedExpansion

 FOR %%I IN (*) DO (
   REM ECHO %%I
   SET  xname=%%I
 
   for /f "tokens=1,2 delims=_" %%a in ("%%I") do (
     REM ECHO %%a
     REM ECHO %%b  
     REM ECHO !xname!
     SET xname=!xname:%%a_=!
     REM ECHO !xname!
     SET ENDSWITH=!xname:~-4!
     REM ECHO !ENDSWITH!
     IF "!ENDSWITH!"==".csv"  REN %%I  !xname!
     IF "!ENDSWITH!"=="done"  REN %%I  !xname!
   )
)


2.  I faced  a situation where I needed to upload files to server at some intervals and not in one go. I was looking for a way to write script. This is what I did.  I was using winSCP  to upload the file.  I came up with following batch file.

ECHO OFF

SETLOCAL EnableDelayedExpansion

FOR %%I IN (*) DO (
   REM ECHO %%I
   SET  xname=%%I
   SET ENDSWITH=!xname:~-5!
   ECHO !xname!
   copy wscp.txt wscp2.txt
   IF "!ENDSWITH!"==".sgnl"  (
     ECHO Put D:\Users\gbairwa\Documents\reprocess\poc\!xname!  /dest/path/>> wscp2.txt
     ECHO close>>wscp2.txt
     ECHO exit>>wscp2.txt
   )
   type wscp2.txt
   # pause
   "C:\Program Files (x86)\WinSCP\winscp.com" /ini=nul /script=wscp2.txt
   # Below command to introduce some wait/sleep
   ping 192.0.2.2 -n 1 -w 100000 > nul
)

wsp.txt
--------
open -hostkey="ssh-rsa 2048 f8:c3:55:ef:df:45:fc:48:89:48:ac:e8:d5:70:1f:8d" userid:password@host.domain
option transfer binary

Comments

Post a Comment

Popular posts from this blog

SQL

Joins - Not always very obvious ( Following example uses Hive ). create table x_temp ( name string, p_date int  ) insert into x_temp(name,p_date) values ('x1',20181025),('x2', 20181026), ('x3',20181027) create table y_temp ( name string, s_date int  ) insert into y_temp(name,s_date) values ('x1',20181025),('x2', 20181026), ('x3',20181027) create table z_temp ( name string, p_date int, s_date int ) insert into z_temp(name,p_date,s_date) values ('z1','20181025','20181025') select x.*, y.* from x_temp x, y_temp y, z_temp z  where x.p_date != z.p_date and  y.s_date != z.s_date) generates 4 records... x.name,x.p_date,y.name,y.s_date x2, 20181026, x2, 20181026 x3, 20181027, x2, 20181026 x2, 20181026, x3, 20181027 x3, 20181027, x3, 20181027 select x.*, y.* from x_temp x, y_temp y, z_temp z  where x.p_date != z.p_date or  y.s_date != z.s_date) generates 8 records x.name,x.p_date,y....
Read more

Analytics

Types of Analytics ( Notes from AWS Course )  Descriptive - What happened ?  hindsight  Diagnostic - Why did it  happen?  hindsight & insight  Predictive  - What will happen ? insight & foresight  Prescriptive - What should I do ? foresight  Cognitive & AI  - What are recommended actions ? foresight & hypothesis input  Popular BI Tools:  https://www.cio.com/article/3284415/10-bi-tools-for-data-visualization.html
Read more

DBeaver

Recently I used this tool for connecting to Hive via Knox gateway.  Good thing about this tool is that it automatically downloads the driver and configures it. That  is a pain in tools like Squirrel.  It also makes a JDBC connection to Hive.  Below is how the HOST and JDBC URL settings look like : HOST : <KNOX_HOST>:8443/;ssl=true;transportMode=http;httpPath=gateway/<topology>/hive JDBC URL :  jdbc:hive2://<KNOX_HOST>:8443/;ssl=true;transportMode=http;httpPath=gateway/<topology>/hive What I noticed on my setup was that if you keep the default port which 10000 and you set it to 8443 , it does not work. So you have to keep it blank.  That may be specific to my setup. Also you might notice that ssl=true but there are  no  sslTrustStore= < Path to the “.jks” file in the NiFi node > ;trustStorePassword= < TrustStore Password>  parameters. The reason is if you import the gateway cert  into the trus...
Read more