sugar

Price to Performance with SugarCRM and Sun Web Server

Price to Performance with SugarCRM and Sun Web Server

Introduction

As promised in my earlier blog. I've completed the tests and finalized the tuning that gives the best price to performance on the Sun Solaris Operating System. SugarCRM is a Customer Relationship Management software written in PHP and needs the web stack (Web Server, PHP 5, and MySQL 5). We will be exploring options available for the optimal hardware and software combination with the best price to performance for Solaris Operating Environment.

Installation and Configuration

Please refer to my earlier blog http://blogs.sun.com/vanga/entry/scaling_sugarcrm_with_mysql_on on how to install and configure SugarCRM. For a Sun Web Server 7.0 installation along with configuration for PHP, please follow the instructions here http://developers.sun.com/webtier/reference/techart/php2.html. Additionally, I have also provided the configuration files that I used for Sun Web Server to make it work with the PHP installation that came as part of Cool Stack 1.2

Price to Performance Data

Software Stack	Maximum No. of Concurrent Users	% of Requests ( Response Time < 2 seconds)	*Price/Performance
Apache2, MySQL5 and SugarCRM 4.5.1i	900	98.89	39.17 $/User
Sun Web Server 7.0, MySQL5 and SugarCRM 4.5.1i	1300	98.32	27.12 $/User

* Price sheet is provided at the end

Benchmark Configuration

The benchmark configuration consists of Sun SPARC Enterprise T5120 server. I used single server to host both MySQL database and SugarCRM. A separate storage device, the Sun Storage J4200, is attached to the server for MySQL database data and log files. This storage is mounted as two volumes, one for table spaces (/db/data/5.0) and the other for log files (/db/logs/5.0).

Sun SPARC Enterprise T5120

Sun Storage J4200

Hardware Configuration

Sun SPARC Enterprise T5120 Server

• 1 UltraSPARC-T2 Processor 1.2GHz (8 Cores, 8 h/w threads per core)

• 16GB RAM

• 2 x 146GB, 10K RPM Internal SAS Disks

• 4 x 10/100/1000Mbps Ethernet, 2 PCI-X, 4 PCIe

Sun Storage J4200

• 146GB (12 x 146GB SAS Disks)

• Three 3Gb/s Port Connections

Preparing Database

We used Tidbit, a kit provided by SugarCRM to generate the seed data. Using the kit, the SugarCRM database is populated with 2000 users with a load factor of 2000, that breaks down to the following number of records for each module/business object.

Business Objects	Number of Records
Accounts	2000
Calls	48000
Emails	32000
Contacts	8000
Leads	8000
Opportunities	4000
Cases	8000
Bugs	6000
Meetings	16000
Tasks	8000
Notes	8000
Total Records*	*602,644

A total of 602,644 records were inserted to initialize the database for the tests. It includes the main objects and the relationship rows that link the data together.

Tuning Options Used

APC (Alternative PHP Cache) which caches the PHP opcodes that comes bundled with the Coolstack 1.2 is a good start. However, we compiled APC the latest version of APC 3.0.16 with the following options using Sun Studio compilers:

#cd APC-3.0.16 #phpize #./configure --enable-apc --enable-apc-sem --enable-apc-mmap --with-apxs=/opt/coo lstack/apache2/bin/apxs –with-php-config=/opt/coolstack/php5/bin/php-config #make #make install

For Sun Web Server 7.0, I've used the eAccelerator 0.9.5.2 for caching. The tuning for eAccelerator is also provided below:

Solaris 10 Operating System:

We have applied the following tuning options to the /etc/system file

set rlim_fd_max=32768 set rlim_fd_cur=32768 set ip_squeue_soft_ring=1 set ip:ip_soft_rings_cnt=8 set autoup=900

Also to support higher http requests the following ndd parameters were applied.

ndd -set /dev/tcp tcp_conn_req_max_q 16384 ndd -set /dev/tcp tcp_conn_req_max_q0 16384 ndd -set /dev/tcp tcp_naglim_def 1 ndd -set /dev/tcp tcp_smallest_anon_port 2048

Apache2 Configured and Optimized for SugarCRM

The default configuration of Apache httpd.conf loads several modules that are not needed to run SugarCRM. Depending on your web site requirements you can disable most of them. We have used the following minimal set of modules to successfully run SugarCRM.

#httpd.conf ServerRoot "/opt/coolstack/apache2" Listen 0.0.0.0:80 LoadModule authz_host_module modules/mod_authz_host.so LoadModule cache_module modules/mod_cache.so LoadModule mem_cache_module modules/mod_mem_cache.so LoadModule log_config_module modules/mod_log_config.so LoadModule env_module modules/mod_env.so LoadModule mime_magic_module modules/mod_mime_magic.so LoadModule expires_module modules/mod_expires.so LoadModule headers_module modules/mod_headers.so LoadModule setenvif_module modules/mod_setenvif.so LoadModule mime_module modules/mod_mime.so LoadModule suexec_module modules/mod_suexec.so LoadModule cgi_module modules/mod_cgi.so LoadModule php5_module modules/libphp5.so <IfModule !mpm_netware_module> User webservd Group webservd </IfModule> <IfModule mime_module> PHPINIDir /opt/coolstack/php5/lib AddType application/x-httpd-php .php .phtml AddType application/x-httpd-php-source .phps </IfModule> EnableMMAP Off EnableSendfile Off Include conf/extra/httpd-mpm.conf <IfModule mod_mem_cache.c> CacheEnable mem / MCacheSize 32768 MCacheMaxObjectCount 8192 MCacheMinObjectSize 1 MCacheMaxObjectSize 2048 </IfModule>

#httpd-mpm.conf <IfModule mpm_prefork_module> StartServers 1200 MinSpareServers 2000 MaxSpareServers 2000 MaxRequestsPerChild 0 ListenBacklog 8192 ServerLimit 2500 MaxClients 2500 </IfModule>

MySQL Tuning

Before creating the database, please make sure that the following file is saved in /etc/my.cnf in order to pick up the InnoDB configuration while creating the tablespaces and the logfiles. The settings applied to query cache, table cache and thread concurrency. This helps at higher loads and reduces the latency.

#/etc/my.cnf [mysqld] port = 3306 socket = /tmp/mysql.sock datadir = "/db/data/5.0" back_log = 50 max_connections = 5000 max_connect_errors = 10 table_cache = 2048 max_allowed_packet = 2M binlog_cache_size = 8M max_heap_table_size = 128M sort_buffer_size = 64M join_buffer_size = 128M thread_cache_size = 3000 thread_concurrency = 3000 record_buffer = 8M query_cache_size = 256M query_cache_type = 1 query_cache_limit = 4M query_prealloc_size=65536 ft_min_word_len = 4 default-storage-engine = innodb thread_stack = 192K transaction_isolation = REPEATABLE-READ tmp_table_size = 1024M log_long_format server-id = 1 key_buffer_size = 64M read_buffer_size = 8M read_rnd_buffer_size = 64M bulk_insert_buffer_size = 128M innodb_additional_mem_pool_size = 1024M innodb_buffer_pool_size = 2G innodb_data_file_path = ibdata1:4096M:autoextend innodb_data_home_dir = /db/data/5.0 innodb_file_io_threads = 8 innodb_thread_concurrency = 0 innodb_flush_log_at_trx_commit = 1 innodb_log_buffer_size = 16M innodb_log_file_size = 1G innodb_log_files_in_group = 2 innodb_log_group_home_dir = /db/logs/5.0 innodb_max_dirty_pages_pct = 90 innodb_lock_wait_timeout = 120

MPSS and libumem libraries were pre-loaded by making changes to the mysqld_safe script. More information regarding MySQL performance tuning can be found here: http://blogs.sun.com/yufei/entry/mysql_innodb_performance_tuning_on

#mysqld_safe file modified to pre-load MPSS and libumem libraries MPSSHEAP=256M export MPSSHEAP LD_PRELOAD_64="/usr/lib/sparcv9/mpss.so.1 /usr/lib/sparcv9/libumem.so.1" export LD_PRELOAD_64

PHP Tuning

Some of these settings are standard except however we did make changes to the apc default settings.

[PHP] cgi.fix_pathinfo = 1 memory_limit = 320M ; Maximum amount of memory a script may consume (8MB) default_socket_timeout = 1800 safe_mode = 0 post_max_size = 20M upload_max_filesize = 20M [Session] session.use_cookies = 1 session.cookie_lifetime = 0 session.gc_probability = 1 session.gc_divisor = 5000 session.gc_maxlifetime = 0 session.entropy_file = "/dev/urandom" ;session.cache_expire = 300 ;session.cache_limiter = nocache session.save_path = "/tmp/sessions" include_path=/opt/coolstack/php5/lib/php:.: extension_dir=/opt/coolstack/php5/lib/php/extensions/no-debug-non-zts-20060613 extension="mysql.so" extension="mysqli.so" extension="curl.so" extension="zlib.so"

APC Tuning:

Copy the following APC tuning options to the PHP.ini file.

#APC 3.0.16 tuning below extension="apc.so" apc.enabled=1 apc.shm_segments=1 apc.shm_size=128 apc.num_files_hint=2048 apc.user_entries_hint=4096 apc.gc_ttl=3600 apc.cache_by_default=1 apc.mmap_file_mask=/dev/zero apc.slam_defense=0 apc.file_update_protection=2 apc.enable_cli=0 apc.max_file_size=1M apc.stat=0 apc.write_lock=0 apc.report_autofilter=0 apc.include_once_override=1 apc.localcache=0

Sun Web Server 7 and eAccelerator 0.9.5.2 Tuning

#Sun Web Server magnus.conf # # Copyright 2006 Sun Microsystems, Inc. All rights reserved. # Use is subject to license terms. # Init fn="load-modules" shlib="libfastcgi.so"

#Sun Web Server obj.conf # # Copyright 2006 Sun Microsystems, Inc. All rights reserved. # Use is subject to license terms. # # You can edit this file, but comments and formatting changes # might be lost when you use the administration GUI or CLI. <Object name="default"> NameTrans fn="assign-name" from="*.php" name="fcgiPHP" PathCheck fn="find-index" index-names="index.html,home.html,index.jsp,index.php" ObjectType fn="type-by-extension" ObjectType fn="force-type" type="text/plain" Service method="(GET|HEAD|POST)" type="*~magnus-internal/*" fn="send-file" AddLog fn="flex-log" </Object> <Object name="fcgiPHP"> Service fn="responder-fastcgi" app-path="/opt/coolstack/php5/bin/php-cgi" bind-path="localhost:3101" app-env="PHPRC=/opt/coolstack/php5" app-env="PHP_FCGI_CHILDREN=600" app-env="PHP_FCGI_MAX_REQUEST=20000000" app-env="FCGI_WEB_SERVER_ADDRS=127.0.0.1" req-retry="10" min-procs="1" max-procs="1" restart-interval="0" reuse-connection="true" resp-timeout="9999" listen-queue="8192" </Object> <Object name="j2ee"> Service fn="service-j2ee" method="*" </Object> <Object name="es-internal"> </Object> <Object name="cgi"> ObjectType fn="force-type" type="magnus-internal/cgi" Service fn="send-cgi" </Object> <Object name="send-precompressed"> PathCheck fn="find-compressed" </Object> <Object name="compress-on-demand"> Output fn="insert-filter" filter="http-compression" </Object>

# # eAccelerator 0.9.5.2 Tuning # extension="eaccelerator-0952.so" eaccelerator.shm_size="128" eaccelerator.cache_dir="/tmp/eaccelerator" eaccelerator.enable="1" eaccelerator.optimizer="1" eaccelerator.check_mtime="0" eaccelerator.debug="0" eaccelerator.filter="" eaccelerator.shm_max="0" eaccelerator.shm_ttl="0" eaccelerator.shm_prune_period="0" eaccelerator.shm_only="0" eaccelerator.compress="0" eaccelerator.compress_level="9" eaccelerator.allowed_admin_path="/sun/webserver7/https-etg06/docs"

SugarCRM Tuning

I've applied the standard tuning recommended for SugarCRM along with some of the suggestions made here http://www.sugarcrm.com/wiki/index.php?title=Performance_Tweaks_for_Large_Systems. I've also disabled the session.gc_maxlifetime by setting to 0. Please note that if you have policy to expire the sessions it is recommended to use “cron” entry to clear the sessions files from time to time.

Conclusion

In this benchmark, I've been able to get the best price to performance out of the Sun Web Stack for SugarCRM on Sun SPARC Enterprise T5120 and Sun Storage J4200.

Note:

The following bill of material has been used to work out the price of the server and the storage system.

Product Name	Description	Part No.	Quantity	List Price
Sun SPARC Enterprise T5120 Server	Sun SPARC Enterprise T5120 Server, 8 Core 1.2GHz UltraSPARC T2 Processor, 16 GB FBDIMM Memory (8 x 2 GB), 2 x 146 GB 10000 rpm SAS Disks, 1 DVD+/-RW, 4 x 10/100/1000 Ethernet Ports	SECPCEF1Z	1	21,995.00
Power Cord	Power Cord Kit, North American/Asian, RoHS Compliant	X311L	4	0.00
Support	Sun SPARC Enterprise T5120 8-Core Warranty Upgrade to 3 Year Silver Support	IWU-T5120-8-3S	1	4,588.56
	SUB TOTAL			26,583.56
Sun Storage J4200	Sun Storage J4200 Rack-Ready Chassis, No Drives, 2 Redundant AC Power Supplies and 2 Redundant Cooling Fans, Rail Kit, Single SAS I/O Module, 1 x .5M SAS Cable, RoHS-5 Compliant	XTA4200R00A10DISK	1	2,675.00
Sleds	Sun Storage J4200 and J4400 Array, 6 Air Management Sleds, RoHS-5 Compliant	XTA-JBOD-6AMS	2	0.00
Rail Kit	2U Universal Rack Rail Kit, RoHS-5 Compliant	XTA-4200-2URK-19U	1	125.00
Disk	1 Internal 146 GB 15000 rpm SAS Disk Drive, 3.5-Inch with Bracket, RoHS-6 Compliant	XTA-SS1NJ-146G15K	12	400.00
HBA	Sun StorageTek PCIe SAS Host Bus Adapter, 8 Port, RoHS-6 Compliant	SG-XPCIE8SAS-E-Z	1	550.00
Support	Sun Storage J4200 Array Warranty Upgrade to 3 Year Silver Support	IWU-STJ4200-3S	1	516.67
	SUB TOTAL			8,666.67
	TOTAL			35,250.23

Posted at 12:07PM Aug 07, 2008 by Satish Vanga in Sun  |  Comments[3]