User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
o shit now you can search things reliably on this instance
:HyperNeko@mk.absturztau.be:1
1
0
0
1
User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
@iro_miya huh
⭐1
1
0
0
1

User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
@iro_miya @puniko what did you do ​:woozy_ai:​
⭐1
1
0
0
1
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder we can search things now it doesn't immediately throw a timeout
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder ​:akko_woozy:​ that might only be temporary as long as stuff is in memory
🤔1
2
0
0
1
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder will be interesting to see how this evolves
1
0
0
0
User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
@iro_miya @puniko i mean, my workaround for this was increasing the timeout
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@jeder @iro_miya ​:char_nachoneko_baa:​ tried this a couple of times, and it broke my instance massivelly
1
0
0
0
User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
0
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder are you sure about that though? we can search for things that were posted long before the instance troubles happened
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder i mean it depends which index is currently loaded in memory by psql. not the content itself
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder so why would this get worse over time?
2
0
0
0
User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
@iro_miya @puniko because ram isn't infinite?
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@jeder @puniko but it seems that right now there's enough stuff in memory for search to work perfectly? why would that get worse
2
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@jeder @puniko its not like the amount of posts is gonna increase that much this instance has been around for a long time it has a lot of stuff in the DB already
0
0
0
0
User avatar
Jeder neocat_floof_googly_woozy neocat_flag_agender @ eth0 @jeder@miau.jeder.pl
3y
@iro_miya @puniko newer stuff getting into the memory
0
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder because psql will unload stuff in memory when its not getting used for a while
🤔1
2
0
0
1
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder it basically works like a cache. when you run a query, it loads the indices you search on into memory. subsequent query on the same index will run faster because it doesn't have to do all the disk reading stuff for it.
but psql will discard old stuff in memory for newer stuff when the assigned memory limit is reached. so stuff that hasn't been used for a while will not be loaded into memory anymore and the query will take longer
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder but there's no way the entire DB is in memory right now is it

Whatever's in memory right now is perfect... why cant it keep being like that...
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder because other stuff is getting queried too ​:akko_woozy:​

and no, the databases are too big to fit into ram
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder well psql's caching strategy must be kinda bad then ​:woozy_baa:​
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder actually its not bad really. i mean, it would be bad, if it would keep stuff in memory, even if its not used in a while.
1
0
0
0
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder but like right now it's great, so it is possible for the cache to be in such a way that the server works and is responsive, so it's kinda bad if it messes that up over time
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder well, lets say all users on this instance wont search for anything for a couple of days, then it doesn't make sense for psql to keep that into ram which could be used for more current stuff since its not being used. imo expected behaviour of any caching mechanism
🤔1
1
0
0
1
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder would be nice if there were a way to control that
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder there isn't really. at least not that i know off ​:char_nachoneko_baa:​
:woozy_baa@mk.absturztau.be:1
0
0
0
1
User avatar
Ripperdoc. Miya Ironami @iro_miya@mk.absturztau.be
3y
@puniko @jeder well clearly its not doing it very well ​:woozy_baa:​
1
0
0
0
User avatar
猫猫 verifiedsabakan antifa disability_flag @puniko@mk.absturztau.be
3y
@iro_miya @jeder i know my server has bad disk io. still waiting for other hardware to get phased out at work so i can refurbish it and put in some SSDs. this should solve a lot of issues i'm having with my instances.

sadly can't say, when the hardware will get available, since that depends on coworkers
🤔1
0
0
0
1