| |
| |
| |
|
Page: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
Comments:
<bazman> It seems a little absurd to resort to ASCII flat files... this is the kind of stuff a RDBMS is for I thought
<Xgc> bazman: I wonder if limiting the JOIN to a smaller id range might have in interesting impact.
<will> Maybe the approach is wrong? /me has no idea what the problem is...
<Xgc> bazman: Even a well designed engine will have problems as your structures become too large to handle with the given resources.
<bazman> Xgc: I experimented with that
<Xgc> I'm not sure either. It sounded like a data cleaning operation.
<bazman> Xgc: If I limited the IDs to a range of 1000 or 10000 it still selected at the same miserable rate
<bazman> Xgc: yeah, actually it is data cleaning
<Xgc> bazman: That behavior doesn't sound quite right.
<Xgc> bazman: Are there other processes that could conflict with resource/ram usage?
<bazman> Xgc: yeah I was surprised, but I figure if mysql had to do a disk seek for each row it returned, it would have to only return at a few hundred per second
<bazman> no
<Tokeiito> good evening
<bazman> Xgc: the tmp_list (smaller table) contains IDs of about 25% of what's in the larger table, and those records are spread throughout the table pretty evenly
<n3mr0d> hello! whats the command to execute a sql file that create the tables?
<bazman> Xgc: Do you think this isn't necessarily an appropriate use for mysql? Have any other recommendations for tools?
<Tokeiito> maybe someone has Manual about planing/(creating designe of) mysql database?
<Xgc> bazman: I haven't heard enough about your requirements.
<bazman> basically I have a semi-large collection of data that I want to manipulate based on IDs
<bazman> I have two primary operations
<bazman> matching data against regexes
<bazman> and sorting it on a number of columns and then feeding that through perl programs
<bazman> the perl code then flags certain IDs
<bazman> It worked great when I was only flagging a million records or so, but then one operation ended up flaggin 22 million, and that took waaay too long
<ries> Tokeiito: kelco has some good books, planning and design has not to much to do with mysql...
<bazman> Previously each "flagging" consisted of "insert into dup (select * from orig where id = ?)" and then after a few hundred thousand rows were added I would "delete from orig using orig o join dup d on d.id = o.id"
<Tokeiito> thnx ries.
<Narada|flat> Hi. I'm getting this error:ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2); any ideas?
<bazman> so really the only thing I've used mysql for is indexing my ID columns and sorting
<bazman> and even sorting has been a real headache
<Xgc> bazman: It's still unclear what the goal is here. I see that you find records; insert them into another table; then delete them from the original set. Do you really need to do this? can you simply UPDATE the original records to perform this "flagging" and not move/delete the records?
<bazman> Xgc: I suppose I could
<Xgc> bazman: That would eliminate lots of traffic.
<bazman> Xgc: I'm starting to get the impression that these two features I'm using mysql for could be accomplished more efficiently with a simpler non-relational DB that I don't know about
<bazman> Xgc: and you're right, I should never have messed with separate tables
<Xgc> bazman: Could be. I don't get the same feeling.
<Xgc> MySQL seems fine for this. It's just the constant movement of the data that is odd.
<bazman> Xgc: a few days ago I was in here complaining about how an alter table command to even change the order of columns takes many hours, when dumping it into a separate table, truncating the original, altering it, and reloading it was much faster. Otherwise I probably would have added more columns
<Xgc> bazman: Changing structure can sometimes be a headache, with any engine. Oracle has a similar *feature* in 9i that prevented a compressed table from being uncompressed to ALTER (add a column).
<Xgc> It just fails. Oracle marked this as an enhancement in 10g. :)
<bazman> Xgc: That makes me feel better. A couple of times I've thought that oracle might make this easier, but it probably wouldn't
<bazman> Xgc: The other headache I was running into that I aluded to is that mysql fails to sort if I select too many columns
<Xgc> Hmmm? The ORDER BY doesn't do as expected?
<bazman> apparently it actually stores the entire output row you're selecting in the temporary sort file
<bazman> Xgc: no, it fails with an error code 28
<Xgc> Ouch.
<Xgc> bazman: That's a bit of a resource issue.
<Xgc> !perror 28
<SQL> System error: 28 = No space left on device
<bazman> Xgc: yeah, it crunches for a couple hours, and then it dies. Yeah, I was hoping 40G of free space would be enough, but apparently not. The entire table is only 8 or 9G, and I'm only sorting and selecting certain rowns
<bazman> so "select foo, id from orig order by foo, id desc into outfile 'blah'" works, but not "select foo, bar, baz, quux from orig ...". I have yet to test "select foo, id from orig order by foo, bar, baz, quux" (selecting only two colums, but sorting on multiple columns. This could be a possible work around)
<bazman> I certainly don't have an optimum set up for this. Ideally I'd have a bunch of disks I could stripe together
<Dudev|1727> i'm getting the error "cannot connect to local mysql server through socket '/var/run/mysqld/mysqld.sock'
<Dudev|1727> i'm in /var/run/mysqld now, and ls shows nothing there
<Dudev|1727> where can I get mysqld.sock?
<bazman> Dudev|1727: does ps show that mysqld is running?
<Dudev|1727> it's running
<Narada|flat> Dudev|1727: I just had the same problem. I solved it by killall -9 mysql && /etc/init.d/mysql start.
<Dudev|1727> okay i'll try that
<Dudev|1727> thanks
<will> No
<will> Look for mysqld.sock elsewhere on your drive.
<will> Or mysql.sock
<Narada|flat> Well it worked for me.
<Dudev|1727> i did locate mysqld.sock and got nothing
<will> Don'
<will> t use locate either.
<Narada|flat> I used find.
<will> find / -name 'mysql.sock'
<Dudev|1727> okay
<Narada|flat> There was no mysqld dir or sock file.
<will> locate needs to be updated. MySQL creates the sock file when it gets started.
<Dudev|1727> ah
<Narada|flat> That's if it has created one at all.
<will> It does create one.
<Narada|flat> Well all the configs tell it to create it in /var/run/mysqld/ but in my case it wasn't there.
<will> You probably didn't see all of it then.
<will> Check /tmp
<Dudev|1727> yeah it's in temp
<Dudev|1727> tmp
<Narada|flat> Then I found mysqld was already running. So I killed it and restarted it and found the sock file had reappeared.
<will> :)
<Dudev|1727> bbl food
<will> Dudev|1727, You have some config issues. Probably an RPM install and you installed the binary version. Cross configs confusing everything.
<will> bbl oil change.
<raden> ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)
<raden> ?
<bazman> Xgc: thanks for the help, BTW
<Harry> when i change a setting in my.cnf and do a killall -HUP, will mysql respect the changed setting?
<cornell_afk> Leithal: I'm back... and I've removed MySQL4 and php-MySQL...
<cornell_afk> I've installed MySQL-client-5.0.18-0, MySQL-server-5.0.18-0, MySQL-shared-5.0.18-0
<emilylove> heya everyone...got an easy question...
<cornell_> I tried to install php5-mysql (via urpmi php5-mysql) and got: Some package requested cannot be installed: php5-mysql-5.0.2-1mdk.i586 (due to unsatisfied libmysqlclient.so.12)
<emilylove> I'm trying to write a query to concatinate a value at the end of a field. Currently I have UPDATE MyTable Set MyField=Myfield+'blahblahblah';
<emilylove> am I on the right track?
<cornell_> Googling "libmysqlclient.so.12
<Harry> my version does not accept the new value of my.cnf and keeps displaying the old. but it's quite an old version from debian stable. I tried reload and refresh and couldn't find about it in the docs...
<kuja> cornell_: Install the mysql client package
<cornell_> Googling "libmysqlclient.so.12", I got a lot of hits about people getting this when installing on mysql 4
<cornell_> kuja: MySQL-client-5.0.18-0
<bazman> emilylove: use "set myfield = concat(myfield, "blahblah");
<cornell_> kuja: MySQL-client-5.0.18-0 isn't the mysql client package?
<kuja> cornell_: That should be, but does it correspodn to your php5-mysql-5.0.2?
<kuja> correspond, even
<bch2> which is the right MySQL to download with dual Xeon processors?
<emilylove> thanks bazman :-)
<cornell_> Don't know, kuja. It may not, it's a package known to urpmi, but I had to download the mysql5 packages from mysql.com. Where can I get the rpm for php5-mysql that goes with 5.0.18? Is php5-mysql a mysql product, or php, or someone else?
<kuja> I have no idea how Mandrake's packages work... sorry
<bch2> am I stuck getting the x86 version of MySQL with Xeon processors?
<cornell_> Well, the mysql5's are "generic"... not Mandrake. and urpmi is very redhat rpm-like
<anoeromos> hello everyone.I am trying to make a trigger with query browser .If the trigger is simple everything is ok.But when i put some If clauses (which works fine in sql server) i get syntax errors :( .What i do wrong?Is the query browser the problem?
<cornell_> I've found www.php-mysql.org, which is a german(?) site about using it, I don't see anything about downloads.
<kuja> cornell_: So you installed the client libraries from MySQL's official distribution, bu have you tried looking for one in Mandrake's packages?
<cornell_> Is php5-mysql a mysql product, or php, or someone else?
<kuja> php5-mysql should be ext/mysql for php
<kuja> Though I'm thinking ext/mysql won't work with a 4.1.x or 5.0.x client API.
<kuja> You might need < 4.0.x
<kuja> That's what ext/mysqli is for
<cornell_> kuja: ?
<kuja> I have no idea if you're trying to get ext/mysql to work or not.
<cornell_> I don't know what ext/mysql is... I'm trying, first, to get phpMyAdmin to work, and it uses the mysql, or mysqli, functions in php, so I understand I need php-mysql. because of the version levels, it should be php5-mysql
<cornell_> I've found a package for php5mysql 5.0.3-6, might that be good?
<kuja> Uh, doesn't Mandrake have a package manager... like yum or apt that will do dependency checking and stuff for you?
<kuja> You shouldn't have to fiddle around with packages like this.
<Darien> he wouldn't if he had a good distro
<kuja> I've always tried to stay away from Mandrake
<kuja> cornell_: If Mandrake requires you to go through this much pain to setup PHP with MySQL, I highly suggest you to switch to another Linux distribution.
<cornell_> kuja, yes it has urpmi... but the php5-mysql it tries to install is 5.0.2. Probably because that's whats on the sites it's aimed at. I did the mysql5 packages by downloading them from the mysql site, and urpmi'ing the actual packages.
<kuja> On Debian or Ubuntu, it's as easy as: apt-get install php5-mysql <-- No errors, it just *works*
<cornell_> Now, I'm looking for the package (right package) to download to urpmi.
<kuja> Right
<kuja> I haven't done that much painful stuff in years :P
<kuja> cornell_: Your problem is that you lack a good package manager. Maybe you should try getting yum for Mandrake or something... I'm sure it's possible
<kuja> cornell_: I can't imagine the frustration of manually installing a package by hand every time you want something.
<cornell_> I think the package manager is good. I think the ... sources ... to which it looks are ... insufficient. But I don't know enough about the sites, good or bad, to change/add new ones
<Tanker_> hello ppl
<kuja> cornell_: php5-mysql is part of your Mandrake packages right?
<cornell_> I've found a package on rpm.pbone.net, downloaded it and installed it
<Tanker_> i got a problem im trying writing a php file that needs to select from two tables
<kuja> If php5-mysql is part of Mandrake's packages, then when you install it, it should look for the dependencies it requires (such as the RIGHT libmysqlclient) and Mandrake doesn't do that. So thus I concluce that Mandrake's package manager is... not good
<cornell_> Um... well, my mandrake is 10.1 (can't upgrade). I've removed the cd's from the package manager and added some sites, on the advice of another, so that when I install, I "get the latest versions"... that hasn't workd too well ;-)
<kuja> cornell_: Are you in the position where you can switch to another distribution?
<phpdjt> can i use a variable in a order by clause? like ... ORDER BY '$sort_opt'
<DjViper> yes
<DjViper> wee
<kuja> Although that has nothing to do with MySQL, yes you can.
<DjViper> err
<DjViper> thats php
<DjViper> ok
<cornell_> Dang, and now phpmyadmin won't install, because it doesn't have php-mysql
<cornell_> NOt really, kuja. When I tried to go to mandriva (the next up from mandrake 10.1) it wouldn't work with my hardware.
Return to
#mysql
or
Go to some related
logs:
The following signatures were invalid: BADSIG 010908312D230C5F
#perl
resolc.conf restart
authentication token lock busy
Across the Nigthingale floor
gentoo Module md not found
xubuntu not graphical
#fedora
play musepack debian sarge
ubuntu kernel 2.4.32 depmod
|
|
