Contents

Capturing Groups and Back Reference (\d)\d\1    -> matches : 808,717,505  not matches : 456 ,446 ( ) capturing group \1 referance to first group captured. (?<d1>)(?<d2>)   referrance $+{d2} $+{d1}   naming a group (?:) non  capture the name or referance in memory ------------------- ?  : one or mone      -?   - is optional + : one or more      dd * :  zero or more , not one \d{2} : length 2    22,33,43,54 not: 3213,434,214 example \D  or  [^0-9]  or  [^\d]    :  non-digit \w  only word equal to [a-zA-Z0-9]    \W upper "w" is non-word .* : any matches ?i :  (keyword?i)  not case-sensitive  equal to (keyword|Keyword|KEYWORD|KEYword.....) HTML  matching tags transforming plain text with sed appending tags transforming plain text with perl Quantifier : 7{1,}  equals to 7+ one or more 7{0,}  equals to 7* zero or more 7{0,1}  equals to 7?  optioanl Regex website list 

1. http://regexpal.com/
2. http://www.regexr.com/

sqlsrv mssql   taking average of datetime column  with groupby select  cast(avg(cast([column1] as float)) as datetime)  from  tablename

ifconfig : 

print the network interface
$ ifconfig | cut -c-10 | tr -d ' ' | tr -s '\n'  

grep ing ip address
$ ifconfig wlan0 | egrep -o "inet addr:[^ ]*" | grep -o "[0-9.]*"

192.168.0.82

host muslum21.com

nslookup muslum21.com

http://www.comptechdoc.org/independent/networking/guide/netrouting.html

Scheduling 

* * * * * /bin/execute/this/script.sh

	* * * * *
minute (from 0 to 59) hour (from 0 to 23) day of month (from 1 to 31) month (from 1 to 12) day of week (from 0 to 6) (0=Sunday)	every minute of every hour of every day of the month of every month and every day in the week.

@reboot Run once, at startup @yearly Run once a year "0 0 1 1 *" @annually (same as @yearly) @monthly Run once a month "0 0 1 * *" @weekly Run once a week "0 0 * * 0" @daily Run once a day "0 0 * * *" @midnight (same as @daily) @hourly Run once an hour "0 * * * *" Leaving the rest of the fields empty, this would be valid: @daily /bin/execute/this/script.sh

• rsync :  advatage  over cp is rsync uses strong difference algorithm 
• dd :  clone harddrive
• version control  based git,apache subversion

• mksquashfs :  file system

• diff  : file difference

backup options :

• writing bash script
• exclude  file or files by cri,teria
• backup in remote host
• scheduling backup  at interval

Email regex pattern :[A-Za-z0-9._]+@[A-Za-z0-9.]+\.+[A-Za-z]{2,4} egrep -o  '[A-Za-z0-9._]+@[A-Za-z0-9.]+\.+[A-Za-z]{2,4}'  filename.txt URL regex pattern : http://[a-zA-Z0-9\-\.]+\.[a-zA-Z]{2,4}   egrep -o  ' http://[a-zA-Z0-9\-\.]+\.[a-zA-Z]{2,4}'    filename.txt

$ cd source_folder $ grep "any_function()" . -R -n

Commands cut: column in file  such as csv grep: grep with xargs sed :  using sed to perfom text replacement in a file. used with regular patern Using awk for advanced text processing  awk is a tool  designed for data stream ,it can also operate on column, rows.it supports built-in functions like arrays, functions. biggest advantage is flexibility. awk ' BEGIN{ print "start" } pattern { commands } END{ print "end" }  file The awk command works in the following manner: 1. Execute the statements in the BEGIN { commands } block. 2. Read one line from the file or stdin, and execute pattern { commands }. Repeat this step until the end of the file is reached. 3. When the end of the input stream is reached, execute the END { commands } block.

SELECT  date_sub(now(),interval 1 day)  from table limit 1    ///   1 day ago SELECT  date_sub(now(),interval 1 week)  from table limit 1  /// 1 week ago SELECT  date_sub(now(),interval 1 month)  from table limit 1  /// 1 month ago

Here are some differences between the two languages: Java is a statically typed language; JavaScript is dynamic. Java is class-based; JavaScript is prototype-based. Java constructors are special functions that can only be called at object creation; JavaScript "constructors" are just standard functions. Java requires all non-block statements to end with a semicolon; JavaScript inserts semicolons at the ends of certain lines. Java uses block-based scoping; JavaScript uses function-based scoping. Java has an implicit this scope for non-static methods, and implicit class scope; JavaScript has implicit global scope. Here are some features that I think are particular strengths of JavaScript: JavaScript supports closures; Java can simulate sort-of "closures" using anonymous classes. (Real closures may be supported in a future version of Java.) All JavaScript functions are variadic; Java functions are only variadic if explicitly marked. JavaScript prototypes can be redefined at runtime, and has immediate effect for all referring objects. Java classes cannot be redefined in a way that affects any existing object instances. JavaScript allows methods in an object to be redefined independently of its prototype (think eigenclasses in Ruby, but on steroids); methods in a Java object are tied to its class, and cannot be redefined at runtime.

Creating  a file size  1Mb

$ dd if=/dev/zero of=junk.data bs=1M count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00767266 s, 137 MB/s



intersection and set differances  (A-B)  on text files

commands : sort  comm

$ comm A.txt B.txt -1 -3
-2 -3 removes the second and third columns

finding and deleting dublicate files  

by comparing files content example script exist in pdf or web  awk {}  used



working with file permission, ownership and the stiky bit

chmod   used to modify the permission

chown used to change the ownership of the file

-R option to apply cmd recursively

The sticky bit is an interesting type of permission applied to directories. By setting the sticky
bit, it restricts only the user owning it to delete the files even though group and others may
have sufficient permissions.
In order to set the sticky bit, +t is applied on a directory with chmod as follows:
$ chmod a+t directory_name



Making File immutable

when a file is immutable  that means any user cannot remove it

/etc/mtab

immutable a way of securing the file such as  /etc/resolv.conf

command :  # chattr +i file or -i 



Using loopback files

command : mount -o loop, dd,

$ dd  if=/dev/zero of=muslum21.img  bs=1G count=1
$mkfs.ext4 muslum21.img 
$file muslum21.img  ##  to test file information approval

then mount to any folder create a folder mkdir   muslum_folder
$ mount -o loop muslum21.img  muslum_folder

now your storage is ready.



Creating iso files and hybrid iso

# cat /dev/cdrom > image.iso  or  # dd if=/dev/cdrom of=image.iso

$ mkisofs -V "Label" -o image.iso source_dir/

hybrid iso is for usb storage devices   with  command  isohybrid  it can be



Finding differences between files and patching 

command: diff, diff -u,

patch  -naur  for applying patches.



head and tail command :  first 10 lines and last 10 lines .

You will probably want to use this on logfiles. The command to monitor the growth of the files
would be:
# tail -f /var/log/messages

ls ,cd , pwd , vi, gedit, cp,mv,rm,pico,touch

history

cat -n (-n line number)

>> or 2> save to file the output

script and scriptreplay  command  like videoplayer you can record the code uyou write  to terminal.

$ script -t 2> timing.log -a output.session
type commands;
…
..
exit

$ scriptreplay timing.log output.session

find  /home/muslum -name "*.php"     finds php files

-iname ignore case sensitive

-path search path

-regex :  $ find . -regex ".*\(\.py\|\.sh\)$"

using more condition:

new.txt some.jpg text.pdf
$ find . \( -name "*.txt" -o -name "*.pdf" \) -print
./text.pdf
./new.txt

find by  file ( access time - time, modification time -mtime , change time -ctime )  -ctime +7   means before  7 day ago 

search based on file size

-delete  : deleting matched files

serach based on permission (755) and ownership

$ find . -type f -name "*.php" !-perm 644 -print

$ find . -type f -user slynux -print

exec chown  username {}  changes file owner  change can be done by a mathes

serach  -prune  ignore matches

xargs

output  |  tr 'find text' 'replace text'

tr -d delete option

For example:
$ echo "Hello 123 world 456" | tr -d '0-9'

Hello world

tr -s

echo "ddddd 432  ddsa  dd"  | tr -s  'dd '
output :  "d432  dsa  d"

Checksum and Varification

$ md5deep -rl directory_path > directory.md5
# -r to enable recursive traversal
# -l for using relative path. By default it writes absolute file path in
output
Alternately, use a combination of find to calculate checksums recursively:
$ find directory_path -type f -print0 | xargs -0 md5sum >> directory.md5
To verify, use the following

Cryptographic tool and Hashes

cript ,  gpg,  base64, md5sum, sha1sum, opensslpasswd

Sorting unique and dublicates

commands: sort ,uniq

sorting file content  in alpha,numeric,reverse,merge sorted, and unique
sorting according to key and column

# Sort reverse by column1
$ sort -nrk 1 data.txt
4 linux 1000
3 bsd 1000
2 winxp 4000
1 mac 2000
# -nr means numeric and reverse

spliting file and data

you can spli5t files by matches and based on its content data, extension

split ,csplit

$ split [COMMAND_ARGS] PREFIX

$ csplit server.log /SERVER/ -n 2 -s {*} -f server -b "d.log" ; rm
server00.log
$ ls
server01.log server02.log server03.log server.log

based on extension

he name from name.extension can be easily extracted using the % operator. You can
extract the name from "sample.jpg" as follows:
file_jpg="sample.jpg"
name=${file_jpg%.*}
echo File name is: $name
The output is:
File name is: sample
The next task is to extract the extension of a file from its filename. The extension can be
extracted using the # operator as follows:
Extract .jpg from the filename stored in the variable file_jpg as follows:
extension=${file_jpg#*.}
echo Extension is: jpg
The output is:
Extension is: jpg

Rename 

 Renaming *.JPG to *.jpg:

$ rename *.JPG *.jpg

To replace space in the filenames with the "_" character:
$ rename 's/ /_/g' *
# 's/ /_/g' is the replacement part in the filename and * is the wildcard for the
target files. It can be *.txt or any other wildcard pattern.
To convert any filename of files from uppercase to lowercase and vice versa:
$ rename 'y/A-Z/a-z/' *
$ rename 'y/a-z/A-Z/' *
To recursively move all the .mp3 files to a given directory:
$ find path -type f -name "*.mp3" -exec mv {} target_dir \;
To recursively rename all the files by replacing space with the "_" character:
$ find path -type f -exec rename 's/ /_/g' {} \;

spell check and dictionary manipulation 

grep , look,  aspell list

$ look word filepath
Or alternately, use:
$ grep "^word" filepath

Automating interactive input

Making commands quicker by running parallel processes

yum -y update --skip-broken

the command  will skip broken packages with er. so there would not be error and continue working system. then you can try again same command  to update the packages without er. and updated system. bye bye..

login console as root apt-get install php5-curl that is all and check  you phpinfo

Hello linux ! Hello Webserver apache, nginx ! Hello python ! Hello Networking ! and Hello ...

[CODE] server { listen 80; server_name wiki.example.com; root /home/example.com/wiki/www; location / { index index.php; rewrite ^/$ /wiki/Main_Page permanent; } # 2 rewrite rules rewrite ^/wiki/([^?]*)(?:\?(.*))? /w/index.php?title=$1&$2; rewrite ^/wiki /w/index.php; # Your FCGI configuration here location ~ \.php$ { fastcgi_pass 127.0.0.1:9000; fastcgi_index index.php; fastcgi_param SCRIPT_FILENAME /home/example.com/wiki/www$fastcgi_script_name; include fastcgi_params; } } [/CODE]

NOTES: Configration code blocks :  http, location, server related websites: maxmind Monitorix (Stub status) Google-perftools

function GetSelectedValues(selection){ return $(selection).map(function() { if($(this).val() !== "") return $(this).val(); }).get().join(","); } function GetSelectedAttr(selection,attrx){ return $(selection).map(function() { return $(this).attr(attrx) ; }).get().join(","); }

jqPlot is a plotting and charting plugin for the jQuery Javascript framework. jqPlot produces beautiful line, bar and pie charts with many features:

An Open-Source JavaScript Library for Mobile-Friendly Interactive Maps Leaflet is a modern open-source JavaScript library for mobile-friendly interactive maps. It is developed by Vladimir Agafonkin with a team of dedicated contributors. Weighing just about 33 KB of JS, it has all the features most developers ever need for online maps.