cassandra - JVM Crashed : Java Heap space -

-

we in process of testing cassandra, part of project save images (confidential images cannot placed on disk) directly database.

we saved 380 images of 909 mb no issues in 8 mins.

the heap size setting follows.

 max_heap_size="4g"  heap_newsize="1024m"

the total size of table 822 mb.

the issue when try fetch 1 record runs fines, moment increase search id between 1 , 4, below error.

info  12:51:52 concurrentmarksweep gc in 228ms.  cms old gen: 172017888 ->  200306216; par eden space: 53693192 -> 30464688; par survivor space: 6681832 -> 0 java.lang.outofmemoryerror: java heap space dumping heap java_pid2548.hprof ... info  12:51:55 concurrentmarksweep gc in 452ms.  cms old gen: 200301712 -> 200301512; par eden space: 53284648 -> 52721832; heap dump file created [275541785 bytes in 2.173 secs] error 12:51:55 exception in thread thread[messagingservice-incoming-/192.168.0.46,5,main] java.lang.outofmemoryerror: java heap space         @ org.apache.cassandra.utils.bytebufferutil.read(bytebufferutil.java:350) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.utils.bytebufferutil.readwithlength(bytebufferutil.java:311) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserializecolumnbody(columnserializer.java:132) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:109) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:101) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:110) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:89) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:74) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:79) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:77) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:63) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.messagein.read(messagein.java:99) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.receivemessage(incomingtcpconnection.java:188) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.receivemessages(incomingtcpconnection.java:170) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.run(incomingtcpconnection.java:88) ~[apache-cassandra-2.1.8.jar:2.1.8] java.lang.outofmemoryerror: java heap space         @ org.apache.cassandra.utils.bytebufferutil.read(bytebufferutil.java:350)         @ org.apache.cassandra.utils.bytebufferutil.readwithlength(bytebufferutil.java:311)         @ org.apache.cassandra.db.columnserializer.deserializecolumnbody(columnserializer.java:132)         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:109)         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:101)         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:110)         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:89)         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:74)         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:79)         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:77)         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:63)         @ org.apache.cassandra.net.messagein.read(messagein.java:99)         @ org.apache.cassandra.net.incomingtcpconnection.receivemessage(incomingtcpconnection.java:188)         @ org.apache.cassandra.net.incomingtcpconnection.receivemessages(incomingtcpconnection.java:170)         @ org.apache.cassandra.net.incomingtcpconnection.run(incomingtcpconnection.java:88) error 12:51:56 jvm state determined unstable.  exiting forcefully due to: java.lang.outofmemoryerror: java heap space         @ org.apache.cassandra.utils.bytebufferutil.read(bytebufferutil.java:350) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.utils.bytebufferutil.readwithlength(bytebufferutil.java:311) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserializecolumnbody(columnserializer.java:132) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:109) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnserializer.deserialize(columnserializer.java:101) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:110) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.columnfamilyserializer.deserialize(columnfamilyserializer.java:89) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:74) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.row$rowserializer.deserialize(row.java:79) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:77) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.db.rangeslicereply$rangeslicereplyserializer.deserialize(rangeslicereply.java:63) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.messagein.read(messagein.java:99) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.receivemessage(incomingtcpconnection.java:188) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.receivemessages(incomingtcpconnection.java:170) ~[apache-cassandra-2.1.8.jar:2.1.8]         @ org.apache.cassandra.net.incomingtcpconnection.run(incomingtcpconnection.java:88) ~[apache-cassandra-2.1.8.jar:2.1.8] info  12:51:56 concurrentmarksweep gc in 454ms.  cms old gen: 200295432 -> 73311840; par eden space: 53739520 -> 0; par survivor space: 6684672 -> 0


Comments

Post a Comment

Popular posts from this blog

html - Firefox flex bug applied to buttons? -

-
i'm trying apply flex button on firefox i'm having problem on chrome doesn't happens. this css: .button { display: inline-flex; align-items: center; } as can see in fiddle, "caret" word moved new line, happens if element <button> tag, <div> works expected. http://codepen.io/anon/pen/xblmgx is firefox bug or there css i'm missing? nevermind, looks "mr firefox" doesn't idea... <button> not implementable (by browsers) in pure css, bit of black box, perspective of css. means don't react in same way e.g. <div> would. this isn't specific flexbox -- e.g. don't render scrollbars if put "overflow:scroll" on button, , don't render table if put "display:table" on it. stepping further, isn't specific <button> . consider <fieldset> , <table> have special rendering behavior: data:text/html,<fieldset style="d
Read more

html - Missing border-right in select on Firefox -

-
Image
when put select div width , padding-left, options have no border on right. more, happend if select have width 118px , parent have 15px of padding left! have idea, going on? my code: <!doctype html> <html> <head lang="en"> </head> <body> <div style="width: 1000px; padding-left: 15px;"> <select style="width: 118px;"> <option>a</option> <option>b</option> <option>c</option> </select> </div> </body> </html> and result: here plunker: click it happend on firefox on windows. tested on 40.0.2 version -webkit-box-sizing: border-box; -moz-box-sizing: border-box; -ms-box-sizing: border-box; box-sizing: border-box; source: https://stackoverflow.com/a/11390432/4431269 source of problem: https://bugzilla.mozilla.org/show_bug.cgi?id=924068 and use of google ! edit: (source of problem, explained) after rea
Read more

python - build a suggestions list using fuzzywuzzy -

-
i building suggestion engine database. i'm using fuzzywuzzy module match user input string existing database shown below. if request.method == "get": display_dict = {} user_input = request.get["user_input"] # user input match_dict = {} food_items_obj = food_items.objects.all() # fetch objects table items in food_items_obj : match = fuzz.ratio(user_input.lower(),items.name.lower()) # try match user input existing names match_dict[match] = items.name # put 1 dictionary matched_dict = ordereddict(sorted(match_dict.items(),reverse = true)) # sort dictionary if max(matched_dict.keys()) == 100: # if exact match put in dict , return display_dict[100] = matched_dict[100] else : # if not found try best matching words.. ###########this part need help! ############# k,v in matched_dict.items(): if user_input in v : display_dict[k]
Read more