is the grammer based approach best approach to get structured data out of llama 7b ?

[vishugupta96]

Hi,
i am using llama 2 7B with grammar to turn unstructured data into structured json format
But i am unable find a lot of examples of this , i mean not a lot people are using this approach .
should i be using this for my project,
as i cannot use chat gpt for security reasons is there a better way to like:
using llama 13b with prompts without grammar or
some other entity extraction model
please suggest
thanks

[KerfuffleV2]

If you need to guarantee that the result conforms to a grammar, I don't think you have a different alternative other than writing your own grammar sampler.

Otherwise you can try prompting the model to output in the format you want. If you're satisfied with the results, then you wouldn't need to use grammar sampling.