How to reclaim space in InnoDB when innodb_file_per_table is ON

How to reclaim space in InnoDB when innodb_file_per_table is ON:

When innodb_file_per_table is OFF and all data is going to be stored in ibdata files. If you drop some tables of delete some data then there is no any other way to reclaim that unused disk space except dump/reload method.

When Innodb_file_per_table is ON, each table stores data and indexes in it’s own tablespace file. However, the sharedtablespace-ibdata1 can still grow and you can check more information here about why it grows and what are the solutions.

http://www.mysqlperformanceblog.com/2013/08/20/why-is-the-ibdata1-file-continuously-growing-in-mysql/

Following the recent blog post from Miguel Angel Nieto titled “Why is the ibdata1 file continuously growing in MySQL?“, and since this is a very common question for Percona Support, this post covers how to reclaim the space when we are usinginnodb_file_per_table. Also, I will show you how to do it without causing performance or availability problems with the help of our Percona Toolkit.

When you remove rows, they are just marked as deleted on disk but space will be consumed by InnoDB files which can be re-used later when you insert/update more rows but it will never shrink. Very old MySQL bug : http://bugs.mysql.com/bug.php?id=1341

But, if you are using innodb_file_per_table then you can reclaim the space by running OPTIMIZE TABLE on that table.OPTIMIZE TABLE will create a new identical empty table. Then it will copy row by row data from old table to the new one. In this process a new .ibd tablespace will be created and the space will be reclaimed

Shell

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

mysql> select count(*) From test; +----------+ | count(*) | +----------+ | 3145728 | +----------+ root@nil:/var/lib/mysql/mydb# ll -h ... -rw-rw---- 1 mysql mysql 168M Sep 5 11:52 test.ibd   mysql> delete from test limit 2000000; mysql> select count(*) From test; +----------+ | count(*) | +----------+ | 1145728 | +----------+   root@nil:/var/lib/mysql/mydb# ll -h ... -rw-rw---- 1 mysql mysql 168M Sep 5 11:52 test.ibd

You can see that after deleting 2M records, the test.ibd size was 168M.

Shell

1 2 3 4 5 6 7 8 9 10 11

mysql> optimize table test; +-----------+----------+----------+-------------------------------------------------------------------+ | Table | Op | Msg_type | Msg_text | +-----------+----------+----------+-------------------------------------------------------------------+ | mydb.test | optimize | note | Table does not support optimize, doing recreate + analyze instead | | mydb.test | optimize | status | OK | +-----------+----------+----------+-------------------------------------------------------------------+   root@nil:/var/lib/mysql/mydb# ll -h ... -rw-rw---- 1 mysql mysql 68M Sep 5 12:47 test.ibd

After OPTIMIZE, you will be able to reclaim the space. As you can see, test.ibd file size is decreased from 168M to 68M.

I would like to mention here that during that process the table will be locked.(Table locked for just Writes) Which can affect to the performance when you’ll have large table. So If you don’t want to lock the table then you can use one of the best utility by Percona, pt-online-schema-change. It can ALTER without locking tables. You can run ALTER TABLE with ENGINE=INNODBwhich will re-create the table and reclaim the space.

(It’s always recommended to use latest version of pt-* utilities)

Shell

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48

mysql> select count(*) from test; +----------+ | count(*) | +----------+ | 2991456 | +----------+   mysql> delete from test limit 2000000;   mysql> select count(*) from test; +----------+ | count(*) | +----------+ | 991456 | +----------+   root@nil:/var/lib/mysql/mydb# ll -h ... -rw-rw---- 1 mysql mysql 157M Sep 6 11:52 test.ibd   nilnandan@nil:~$ pt-online-schema-change --alter "ENGINE=InnoDB" D=mydb,t=test --execute Operation, tries, wait: copy_rows, 10, 0.25 create_triggers, 10, 1 drop_triggers, 10, 1 swap_tables, 10, 1 update_foreign_keys, 10, 1 Altering `mydb`.`test`... Creating new table... Created new table mydb._test_new OK. Altering new table... Altered `mydb`.`_test_new` OK. 2013-09-06T15:37:46 Creating triggers... 2013-09-06T15:37:47 Created triggers OK. 2013-09-06T15:37:47 Copying approximately 991800 rows... Copying `mydb`.`test`: 96% 00:01 remain 2013-09-06T15:38:17 Copied rows OK. 2013-09-06T15:38:17 Swapping tables... 2013-09-06T15:38:18 Swapped original and new tables OK. 2013-09-06T15:38:18 Dropping old table... 2013-09-06T15:38:18 Dropped old table `mydb`.`_test_old` OK. 2013-09-06T15:38:18 Dropping triggers... 2013-09-06T15:38:18 Dropped triggers OK. Successfully altered `mydb`.`test`.   root@nil:/var/lib/mysql/mydb# ll -h ... -rw-rw---- 1 mysql mysql 56M Sep 6 15:38 test.ibd

Same here, you can notice that test.ibd file size decreased from 157M to 56M.