tag:blogger.com,1999:blog-9144505959002328789.post3542951216410619069..comments2024-03-29T08:14:29.447+01:00Comments on Karlsson on databases and stuff: MySQL Cluster / NDB as a key value store - Better results this timeKarlssonhttp://www.blogger.com/profile/04874338187076980133noreply@blogger.comBlogger8125tag:blogger.com,1999:blog-9144505959002328789.post-69990405522413809592012-08-16T00:00:58.679+02:002012-08-16T00:00:58.679+02:00And Bogdan, sorry for my bad speling of your name....And Bogdan, sorry for my bad speling of your name. Completely unintentional.<br /><br />/KarlssonKarlssonhttps://www.blogger.com/profile/04874338187076980133noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-53365435147617808222012-08-15T16:13:19.658+02:002012-08-15T16:13:19.658+02:00Nogdan!
Yeah, I'm certain that this is not...Nogdan!<br /><br /> Yeah, I'm certain that this is not an optimal config för NDB. But I've heard so many times that MySQL Cluster, in particular with NDB, should be a good Key-Value Store. So I wanted to test a KVS based environment, and a simple one with just one server (1-node only, no replication).<br /><br /> What one should be aware of is that RAM prices are going way down right now, so an In-Memory setup with a few 10s of Gb of data can easily fit in an average server box, which is different from a few years ago. So really, not that many machines are needed to support, say, 20 or 30 Gb In-Memory database. Trust, I would have liked to see NDB work better, and I will not give this up, but I do not think that my hardware setup is that weird, except that I should probably have one more box as a replica, but besides that, really having some 4 or 8 boxes is just not required in terms of RAM anymore, but if NDB requires it because of CPU requirements, then so be it, but then MongoDB is probably a lot more cost efficient. And I'd really want NDB to win!<br /><br />/KarlssonKarlssonhttps://www.blogger.com/profile/04874338187076980133noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-4035434174476886612012-08-15T09:58:54.839+02:002012-08-15T09:58:54.839+02:00Hey AK,
Nice to see you'r still playing with ...Hey AK,<br /><br />Nice to see you'r still playing with Cluster :) ... a question - how many data nodes you are running there? How many replicas? From your post it's not clear but looks like you are running either a single data node with noofreplica=1 or 2 data nodes on a single server with noofreplica=2. Neither of those two are optimized for max troughput and there's really no point in running cluster on less then 2 dedicated machines for datanodes.<br /><br />As for windows, you probably have a point there but not that I never seen windows in production, I never seen cluster installed from any type of packages in production - all production systems use tar.gz. Now the cluster manager is slowly creeping in but.. that's a whole other story.. <br /><br />stay good<br />b.Bogdan Kecmanhttps://www.blogger.com/profile/01325622305629819241noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-33276506104007281112012-08-15T00:49:37.251+02:002012-08-15T00:49:37.251+02:00I've verified your bug reports and added one o...I've verified your bug reports and added one of my own (66394). Thanks for reporting the problems - it's clearly something that should have been caught earlier, and I'll work to make sure future releases have adequate testing of the installer packaging.Todd Farmerhttps://www.blogger.com/profile/07381400209965677680noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-81940390403793753982012-08-14T23:45:51.600+02:002012-08-14T23:45:51.600+02:00Antony!
I think so too, bur the CPU is maxed o...Antony!<br /><br /> I think so too, bur the CPU is maxed out and I have tried a whole bunch of things. I guess I could get it to perform better, but there you are. The load is read-only, in-memory only, doing single row reads using primary Key lookups. I know I have a few things to adjust in the NDB API code on the side of my benchmark. I'm not sure how much more I want to play with this though, but so far it's been fun so I'll keep at it a bit more.<br /><br />Cheers<br />/KarlssonKarlssonhttps://www.blogger.com/profile/04874338187076980133noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-1142860062715116102012-08-14T23:38:06.706+02:002012-08-14T23:38:06.706+02:00I still think your ndb numbers are a bit low.
;-)I still think your ndb numbers are a bit low.<br />;-)xhttps://www.blogger.com/profile/09169717992432456581noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-89221545944030366702012-08-14T22:49:14.817+02:002012-08-14T22:49:14.817+02:00Todd!
Yeah, I have written scripts like that...Todd!<br /><br /><br /> Yeah, I have written scripts like that myself, but I was hoping that as an msi package was available, it would actually work, which it doesn't. So it's up to fixing my old scripts and start using it. And actually, all I nedded was the mysqld with the NDB storage engine (which didn't work after using the msi installer either, but I have still to figure out why).<br /><br />Cheers<br />/KarlssonKarlssonhttps://www.blogger.com/profile/04874338187076980133noreply@blogger.comtag:blogger.com,1999:blog-9144505959002328789.post-29178098092433415942012-08-14T21:55:52.463+02:002012-08-14T21:55:52.463+02:00Not to ignore your points about the .MSI package f...Not to ignore your points about the .MSI package for MySQL Cluster, but have you considered the alternatives for deploying Cluster on Windows? I wrote my own startup scripts so that I could use the .ZIP packages (which I prefer):<br /><br />http://mysqlblog.fivefarmers.com/2012/03/16/mysql-cluster-quick-start-script/<br />Todd Farmerhttps://www.blogger.com/profile/07381400209965677680noreply@blogger.com