Skip to content

Instantly share code, notes, and snippets.

View pmwkaa's full-sized avatar

Dmitry Simonenko pmwkaa

187 followers · 0 following
View GitHub Profile
@pmwkaa
pmwkaa / gist:11d896daa08fe2f89a9c
Created February 17, 2016 13:55
rocksdb and sophia (forestdb-benchmark framework)
##################### rocksdb
initialize
[13.7 s] 1000000 / 1000000 (72874.6 ops/sec, N/A, 100 %, 1.01 GB) (-0 s) (-0 s)s)
13.7 sec elapsed
[proc IO] 1083600896 bytes written (1.01 GB)
waiting for background compaction of LevelDB (RocksDB) log files.. done
flushing disk buffer.. done
[proc IO] 1083600896 bytes written (1.01 GB)
13.7 sec elapsed (72564.81 ops/sec)
@pmwkaa
pmwkaa / gist:6667b979a0fce26be472
Created November 4, 2015 15:27
90 billion keys / 3Tb of compressed data in Sophia on a single instance
160-200 Krps, 5-6Mb/s raw incoming data
[root@st-kvsearch1 512]# du -hc .
3.0T .
3.0T total
sophia.build = b7ef756
sophia.error =
@pmwkaa
pmwkaa / gist:3ff8594da2946161e36d
Created January 29, 2015 15:58
sophia v1.2 benchmark
#include <stdlib.h>
#include <stdio.h>
#include <stdint.h>
#include <assert.h>
#include <unistd.h>
#include <pthread.h>
#include <sophia.h>
@pmwkaa
pmwkaa / gist:927e0157e5b5f8b2451c
Created August 18, 2014 07:47
50 million inserts (100byte value + u32 key) / 1m in-memory limit
[ t min, t max) ops count %
--------------------------------------------------
[ 0, 1) 49345841 98.69
[ 1, 2) 3396 0.01
[ 2, 3) 16003 0.03
[ 3, 4) 38951 0.08
[ 4, 5) 52195 0.10
[ 5, 6) 55917 0.11
[ 6, 7) 57549 0.12
[ 7, 8) 60045 0.12
@pmwkaa
pmwkaa / gist:4f7158a88b31ce348722
Created August 18, 2014 07:47
50 million inserts (100byte value + u32 key) / NO in-memory limit
[ t min, t max) ops count %
--------------------------------------------------
[ 0, 1) 49999786 100.00
[ 1, 2) 44 0.00
[ 2, 3) 10 0.00
[ 3, 4) 4 0.00
[ 4, 5) 9 0.00
[ 5, 6) 17 0.00
[ 6, 7) 2 0.00
[ 7, 8) 2 0.00
@pmwkaa
pmwkaa / gist:d9793b2d6f8f266b5b41
Created August 16, 2014 12:02
50 million inserts (100byte value + u32 key) / 6m in-memory limit
[ t min, t max) ops count %
--------------------------------------------------
[ 0, 1) 49935562 99.87
[ 1, 2) 5495 0.01
[ 2, 3) 6593 0.01
[ 3, 4) 6816 0.01
[ 4, 5) 6633 0.01
[ 5, 6) 6863 0.01
[ 6, 7) 6811 0.01
@pmwkaa
pmwkaa / 1.6 vs. 1.5
Created February 28, 2014 16:42
count = 20 million
key = u32
value = 100 ~ 120 per tuple
1.6 benchmark
-------------
space = box.schema.create_space('tweedledum', { id = 0 })
space:create_index('primary', { type = 'tree', parts = { 0, 'num'} })