Nice!
This is some good stuff. Feels like y'all took the original Behemoth model and finally added a little seasoning to it
The original Behemoth was 'fine', but it could be a little bland at times, like it just didn't have much of a creative spark to it, but this one is a fairly solid improvement in terms of characters acting more like themselves and just moving the plot forward in general. I think its the most solid 100b-range model i've had the pleasure of playing with in a pretty long time. Keep up the great work :D
What kind of hardware configuration is required to run this model?
I was using the KoboldAI horde, where someone else was running it. I'm not exactly sure what you'd need for it, but probably a rather beefy GPU or two.
What kind of hardware configuration is required to run this model?
Because it is a large dense model, you need to offload the entire model to VRAM (GPU) to get reasonable speeds. For this model, 3 x RTX 3090 is a common "budget" configuration (72 GB VRAM total). Just 2x3090 is not enough to get good quality (48 GB VRAM).