sobota, 24 grudnia 2011

MySQL - connection class in python

Simple class allowing connect to mysql databse and gather/insert data into it.

Import class system and MySQLdb


import sys
import MySQLdb


Connect to database - if an error occures display message and exit.


def __init__(self,host,user,password,database):
self.database_connect(host,user,password,database)
return

def database_connect(self,host,user,password,database):
try:
self.conn = MySQLdb.connect(host=host, user=user, passwd=password, db=database)
except MySQLdb.Error, e:
print "Connection error\n%d: %s\n" % (e.args[0],e.args[1])
sys.exit(1)
return

Try to connect to database and return cursor.


def cursor_return(self):
try:
self.conn.ping()
except:
self.database_connect()
return self.conn.cursor()


Get one result from database.


def result_return(self,query):
kursor = self.cursor_return()
try:
kursor.execute(query)
except MySQLdb.Error, e:
print "Query error\n%s\n%d: %s\n" % (query,e.args[0],e.args[1])
sys.exit(1)

result = kursor.fetchone()
kursor.close()
return result


Get results from database.


def results_return(self,query):
kursor = self.cursor_return()
try:
kursor.execute(query)
except MySQLdb.Error, e:
print "Query error\n%s\n%d: %s\n" % (query,e.args[0],e.args[1])
sys.exit(1)

results = kursor.fetchall()
kursor.close()
return results


Execute query.


def execute_query(self,query):
kursor = self.cursor_return()
try:
kursor.execute(query)
except MySQLdb.Error, e:
print "Query error\n%s\n%d: %s\n" % (query,e.args[0],e.args[1])
sys.exit(1)
kursor.close()
return


How to us it?



import DBMySQL

c=DBMySQL.DataBase("hostname","username","password","database_example")

t = c.results_return("SELECT id,title FROM films;")

for (i,j) in t:
print "%s %s " % (i,j)



1 Transporter
2 Taxi 1
3 Taxi 2
4 Taxi 3
5 Alien 2
6 Alien 1
7 Alien 3
8 Alien 4
9 The Thing
10 Reservoir dogs

Source code

piątek, 9 grudnia 2011

Apache in jail

Sometimes you need to run few secure services on the same server.
You can use chrooted environment or use jail.

What is jail in FreeBSD ?
It's implementation of operating system-level virtualization that allows administrators to partition a FreeBSD box into several independent mini-systems.
It means that if someone breaks into the jail, he can only move inside jail (of course it depends on system's security).

In my example I've installed apache with php,mysql,mhash,libxml,curl  and some other features.

Step one
Create fresh jail.
You can use my script below:


root@alucard# cat > create_jail.sh

#!/bin/sh

data=`date +%Y-%m-%d-%H:%M`
echo $data
D=/usr/JAIL_$data
cd /usr/src
mkdir -p $D
make -j 24 world DESTDIR=$D
make -j 24 distribution DESTDIR=$D
mount -t devfs devfs $D/dev
cp /etc/resolv.conf /usr/$data/etc/
#EOF


Step two
Enter into the jail and install reqired packages.



root@alucard# chroot /usr/{$date}/ /bin/tcsh

root@alucard_jail# pkg_add -r perl
root@alucard_jail# pkg_add -r cmake
root@alucard_jail# pkg_add -r iconv


After installation make rehash and load libraries:


root@alucard_jail# rehash
root@alucard_jail# ldconfig -m /usr/local/lib


Step three
Download and install from source: apache,php, mysql and rest required software., i.e.:


root@alucard_jail# cd libtool-2.4.2
root@alucard_jail# ./configure
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/lib

root@alucard_jail# cd mhash-0.9.9.9
root@alucard_jail# ./configure --enable-static --with-gnu-ld
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/lib

root@alucard_jail# cd libxml2-2.7.1
root@alucard_jail# ./configure --with-iconv --with-html-dir --with-html-subdir --without-python
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/lib

root@alucard_jail# cd ../libxslt-1.1.19
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/lib

root@alucard_jail# cd ../curl-7.23.1
root@alucard_jail# ./configure
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/lib

root@alucard_jail# cd ../mysql-5.5.19
root@alucard_jail# cmake . -DCMAKE_INSTALL_PREFIX=/usr/local/mysql
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/mysql/lib/

root@alucard_jail# cd ../httpd-2.2.21
root@alucard_jail# ./configure --prefix=/usr/local/apache2 --enable-so --with-mpm=prefork \
--with-port=80 --with-ssl --enable-ssl --enable-modules-all \
--enable-rewrite --with-devrandom --with-egd --with-included-apr \
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/apache2/lib/

root@alucard_jail# cd ../php-5.3.8
root@alucard_jail# ./configure --prefix=/usr/local/php5 --with-layout=GNU \
--with-libxml-dir --enable-dba=shared --enable-safe-mode \
--with-mysql=/usr/local/mysql --enable-bcmath --with-pear --with-mhash \
--enable-soap --with-openssl --with-apxs2=/usr/local/apache2/bin/apxs \
--with-regex=system --with-bz2 --with-curl --with-xsl \
--with-pdo-mysql=/usr/local/mysql --without-iconv \
root@alucard_jail# make && make install
root@alucard_jail# ldconfig -m /usr/local/php5/lib/



Step four
Create required directories in temporary directory i.e.: /tmp/APACHE_JAIL
and copy required binaries and libraries (it is good moment to reduce apache installation
from unused binaries, manuals and help docs).
You can use script below:


root@alucard_jail# cat >  copy_libraries.sh

#!/bin/sh

PWD=`pwd`
PWD_ORIG=`pwd`
LDD_BIN="/usr/local/apache2/bin"
LDD_SO="/usr/local/apache2/modules"

if [ -d /tmp/APACHE_JAIL ]; then
 rm -rf /tmp/APACHE_JAIL
 fi

 mkdir /tmp/APACHE_JAIL
 cd /tmp/APACHE_JAIL/
 PWD_TEMP=`pwd`
 mkdir dev
 mkdir etc
 mkdir lib
 mkdir libexec
 mkdir bin
 mkdir tmp
 mkdir -p "var/run/"
 mkdir -p "usr/local"
 mkdir -p "var/log"

 for zm_tmp in `ls $LDD_BIN`
 do
 for zmienna in `ldd $LDD_BIN/$zm_tmp | awk '{print $3}'`
 do
   cp -n $zmienna "$PWD_TEMP/lib/"
   echo $zmienna
 done
 done

 for zm_tmp1 in `ls $LDD_SO/*.so`
 do
 for zmienna in `ldd $zm_tmp1 | awk '{print $3}'`
 do
   cp -n $zmienna "$PWD_TEMP/lib/"
   echo $zmienna
 done
 done


LDD_BIN="/usr/local/php5/bin"



 for zm_tmp in `ls $LDD_BIN`
 do
 for zmienna in `ldd $LDD_BIN/$zm_tmp | awk '{print $3}'`
 do
   cp -n $zmienna "$PWD_TEMP/lib/"
   echo $zmienna
 done
 done

 for zmienna in `ldd /usr/local/apache2/modules/libphp5.so | awk '{print $3}'`
   do
       cp -n $zmienna "$PWD_TEMP/lib/"
       echo $zmienna
 done

   chmod a+rx $PWD_TEMP/lib/*

   cp /bin/sh $PWD_TEMP/bin/

 for zm_tmp in `ls /tmp/APACHE_INSTALLS/bin/`
 do
   for zmienna in `ldd /tmp/APACHE_INSTALLS/bin/$zm_tmp | awk '{print $3}'`
   do
       cp -n $zmienna "$PWD_TEMP/lib/"
       echo $zmienna
   done
 done

cp -rp /usr/local/apache2 $PWD_TEMP/usr/local/

cp -rp /usr/local/php5 $PWD_TEMP/usr/local/

cp /libexec/ld-elf.so.1 $PWD_TEMP/libexec/

cp -rp /usr/share/zoneinfo/Europe/Warsaw $PWD_TEMP/etc/localtime

chown -R root:wheel $PWD_TEMP
find $PWD_TEMP -type d -exec chmod a+rx {} ";"
find $PWD_TEMP -type f -exec chmod a+r {} ";"
find $PWD_TEMP/lib -type f -exec chmod a-wx {} ";"

#### EOF


Step five
Copy files into your temporary "etc" directory 
(in my case /tmp/APACHE_JAIL/etc )

auth.conf
host.conf
login.conf
master.passwd
pwd.db
spwd.db
group
localtime
login.conf.db
passwd
resolv.conf

You can edit files and delete unnecessary things.
For example group file may look like this

wheel:*:0:root
www:*:80:
nogroup:*:65533:
nobody:*:65534:

Step six
Copy from temporary jail your temporary directory with apache installation into final destination for jail.

Step seven
Configure apache and php in jail.

Step eight
Add into /etc/rc.conf jail settings i.e.:


syslogd_flags="-m 5 -l /usr/jail/APACHE_JAIL/var/run/log -n -s"
# Jail
jail_enable="YES"
jail_list="apache"
jail_set_hostname_allow="YES"
jail_socket_unixiproute_only="YES"
jail_sysvipc_allow="NO"

jail_apache_exec="/usr/local/apache2/bin/httpd -k start -D SSL"
jail_apache_rootdir="/usr/jail/APACHE_JAIL"
jail_apache_hostname="apache.aster.pl"
jail_apache_ip="192.168.10.7"
jail_apache_devfs_enable="YES"
jail_apache_fdescfs_enable="NO"
jail_apache_procfs_enable="NO"
jail_apache_mount_enable="NO"


Step nine
Reload syslog and run jail.

środa, 23 listopada 2011

Annoying "double" panel Ubuntu11.10

Recently I've upgraded my box from Ubuntu 10.04 to 11.10 and after that I lost my panel settings for dual screen.
Below is step-by-step way of moving a panel to another screen:
  1. Right-click the panel you wish to move and select “Properties”.
  2. Uncheck the “Expand” option under the “General” tab.
  3. Grab one of the edges of the panel by clicking on the left or right end (top or bottom end for vertical panels).
  4. Drag the bar to the desired screen and position.
  5. Check the “Expand” option in the “Panel Properties” window and click “Close”.

piątek, 21 stycznia 2011

FreeBSD - konfiguracja VLAN

Wirtualna sieć lokalna (VLAN) jest wydzieloną logiczną siecią komputerową w ramach innej, większej sieci fizycznej. (ang. Virtual Local Area Network, VLAN) – sieć komputerowa wydzielona logicznie w ramach innej, większej sieci fizycznej.



Oznacza to, że za pomocą tego samego fizycznego połączenia sieciowego, niezależnie od lokalizacji, host może być podpięty do różnych podsieci.

Jak to skonfigurować w praktyce?

Na switchu należy skonfigurować port, do którego podpięty jest host:


SW1 (config)#interface gigabitethernet 0/1
SW1 (config-if)#switchport mode trunk
SW1 (config-if)#switchport trunk encapsulation dot1q
SW1 (config-if)#switchport trunk allowed vlan remove 2-1001
SW1 (config-if)#switchport trunk allowed vlan add 3,4
SW1 (config-if)#end



Po stronie hosta należy wykonać poniższe operacje.

1) Załadować moduł vlan ( jeżeli nie jest wkompilowany).

Można zrobić to na 2 sposoby:
       a) Dodać linijkę do /boot/loader.conf:


if_vlan_load="YES"


       b) Uruchomić z "palca":

kldload /boot/kernel/if_vlan.ko


2) Stworzyć interface vlanowy:

[root@] ~ # ifconfig vlan5 create


3) Przypisać adres ip do interfaceu
ifconfig {vlan-name} {ip-address} netmask {subnet-mask} vlan {vlan-id} vlandev {physical-interface}


[root@] ~ # ifconfig vlan5 172.16.79.137 netmask 255.255.255.0 vlan 5 vlandev em2

Poprawnie utworzony vlan powinien wyświetlić po komendzie ifconfig:

vlan5: flags=8843 metric 0 mtu 1500
    options=3
    ether 08:00:27:b2:30:0a
    inet 172.16.79.137 netmask 0xffffff00 broadcast 172.16.79.255
    media: Ethernet autoselect (1000baseT )
    status: active
    vlan: 5 parent interface: em2


Aby zapisać na stałe konfigurację, w pliku /etc/rc.conf należy dokonać wpisów:

cloned_interfaces="vlan5"
ifconfig_vlan5="inet  172.16.79.137 netmask 255.255.255.0 vlan 5 vlandev em2"

środa, 12 stycznia 2011

MySQL - clear table from data

Sometimes you need to clear your database tables from datas without interference  into tables structure.
Below is some trics how to do this:

- simple dump & restore
mysqldump --add-drop-table --no-data dbname -u root -p -h dbhost > dbnamebackup.sql


mysql -u root -p -h dbhost < dbnamebackup.sql


- clever (root permission)
mysql -u root -p -h dbhost -e 'truncate table table;'



- sophistiocated (root permission )- using procedure
DELIMITER $$
 CREATE PROCEDURE `delete_all_tables`(IN dbname varchar(255))
BEGIN

DECLARE done BOOLEAN DEFAULT 0;
DECLARE cmdtmp VARCHAR(2500);

DECLARE cmd CURSOR
FOR
SELECT CONCAT('TRUNCATE TABLE ',dbname,'.',table_name) FROM information_schema.tables WHERE table_schema = dbname;

DECLARE CONTINUE HANDLER FOR SQLSTATE '02000' SET done=1;

OPEN cmd;

REPEAT
    FETCH cmd INTO cmdtmp;
    SET @cmdtmp = cmdtmp;
    PREPARE doit FROM @cmdtmp;
    EXECUTE doit;
    DROP PREPARE doit;

UNTIL done END REPEAT;

CLOSE cmd;

END; $$

DELIMITER ;


How to use?
mysql> call mysql.delete_all_tables("databasename");

niedziela, 9 stycznia 2011

NIC bonding i agregacja linków

Co zrobić aby kilka interface'ów stało się jednym wirtualnym i były odporne na błędy?
Odpowiedź jest prosta użyć interfacu lagg.

Poniżej krótki how-to:

Załadować moduł if_lagg

[root@] ~ # kldload /boot/kernel/if_lagg.ko

Stworzyć nowy interface za pomocą ifconfiga

[root@] ~ # ifconfig lagg0 create
[root@] ~ # ifconfig lagg0 up laggproto failover laggport em0 laggport em1
 
W rezultacie otrzymamy :

lagg0: flags=8843 metric 0 mtu 1500
    options=9b
    ether 08:00:27:a8:15:2f
    media: Ethernet autoselect
    status: active
    laggproto failover
    laggport: em1 flags=1c
    laggport: em0 flags=1c



Teraz wystarczy przypisać adres IP:

[root@] shamrock # ifconfig lagg0 172.16.79.132 netmask 255.255.255.0

lagg0: flags=8843 metric 0 mtu 1500
    options=9b
    ether 08:00:27:a8:15:2f
    inet 172.16.79.132 netmask 0xffffff00 broadcast 172.16.79.255
    media: Ethernet autoselect
    status: active
    laggproto failover
    laggport: em1 flags=0<>
    laggport: em0 flags=1
 


Żeby całość zachowała sie po restarcie w konfiguracji /etc/rc.conf należy wpisać:




ifconfig_em0="up"
ifconfig_em1="up"

cloned_interfaces="lagg0"

ifconfig_lagg0="laggproto failover laggport em0 laggport em1"

ipv4_addrs_lagg0="172.16.79.132/32"

defaultrouter="172.16.79.2"

Natomiast w /boot/loader.conf musi się znaleźć :


if_lagg_load="YES"

poniedziałek, 3 stycznia 2011

Montowanie partycji za pomocą UUID

Czasami zdarza się tak, że po upgradzie Linuxa ( w tym przypadku Debiana) zmienia się określenie dysku np.: zamiast /dev/sda jest /dev/sdb

Można temu zaradzić montując partycje za pomocą UUID (Universally Unique Identifier).

Jak to zrobić ?

1) Sprawdzić jakie partycje mamy zamontowane:

test:~# cat /etc/fstab
# /etc/fstab: static file system information.
#
#              
proc            /proc           proc    defaults        0       0
/dev/sda1       /               ext3    errors=remount-ro 0       1
/dev/sda9       /home           ext3    defaults        0       2
/dev/sda8       /tmp            ext3    defaults        0       2
/dev/sda5       /usr            ext3    defaults        0       2
/dev/sda6       /var            ext3    defaults        0       2
/dev/sda7       none            swap    sw              0       0
/dev/hda        /media/cdrom0   udf,iso9660 user,noauto     0       0
/dev/fd0        /media/floppy0  auto    rw,user,noauto  0       0

2) Wyświetlić atrybuty partycji znajdujących się w /etc/fstab

test:~# cat fstab | grep -v ^# | awk '{ system("blkid "$1)}'
/dev/sda1: UUID="d4cd3659-5e22-41c1-a440-db4012289974" TYPE="ext3"
/dev/sda9: UUID="96f1f6ba-d486-437d-ace3-b3bc90ff7593" TYPE="ext3"
/dev/sda8: UUID="2a3bc90d-1e59-4535-a722-0e1239a896e1" TYPE="ext3"
/dev/sda5: UUID="43e19d71-b2df-4d85-a2b2-8e24400b6f7f" TYPE="ext3"
/dev/sda6: UUID="5d615c76-22f8-4710-b530-0f16f164cce9" TYPE="ext3" 

3) Zamienic wpisy w /etc/fstab tak aby korzystać z UUID

test:~# cat /etc/fstab
# /etc/fstab: static file system information.
#
#              
proc            /proc           proc    defaults        0       0
UUID=d4cd3659-5e22-41c1-a440-db4012289974       /               ext3    errors=remount-ro 0       1
UUID=96f1f6ba-d486-437d-ace3-b3bc90ff7593       /home           ext3    defaults        0       2
UUID=2a3bc90d-1e59-4535-a722-0e1239a896e1       /tmp            ext3    defaults        0       2
UUID=43e19d71-b2df-4d85-a2b2-8e24400b6f7f       /usr            ext3    defaults        0       2
UUID=5d615c76-22f8-4710-b530-0f16f164cce9       /var            ext3    defaults        0       2
/dev/sda7       none            swap    sw              0       0
/dev/hda        /media/cdrom0   udf,iso9660 user,noauto     0       0
/dev/fd0        /media/floppy0  auto    rw,user,noauto  0       0

4) Na koniec jeszcze tylko zmiana w menu.lst dla gruba


title        Debian GNU/Linux, kernel 2.6.26-2-amd64
root        (hd0,0)
kernel        /boot/vmlinuz-2.6.26-2-amd64 root=UUID=d4cd3659-5e22-41c1-a440-db4012289974 ro quiet
initrd        /boot/initrd.img-2.6.26-2-amd64

title        Debian GNU/Linux, kernel 2.6.26-2-amd64 (single-user mode)
root        (hd0,0)
kernel        /boot/vmlinuz-2.6.26-2-amd64 root=UUID=d4cd3659-5e22-41c1-a440-db4012289974 ro single
initrd        /boot/initrd.img-2.6.26-2-amd64