{
  "$type": "site.standard.document",
  "bskyPostRef": {
    "cid": "bafyreihwhtpehqfgisjchbo3u5qzbv3o7oj2r5tg7utztfzfwbgphcegqm",
    "uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3mjf6dunc2rh2"
  },
  "path": "/t/hf-sagemaker-setting-llm-parameters/93234#post_2",
  "publishedAt": "2026-04-13T13:31:11.000Z",
  "site": "https://discuss.huggingface.co",
  "tags": [
    "sagemaker-examples.readthedocs.io",
    "max_length - SageMaker JumpStart Foundation Models - HuggingFace Text2Text..."
  ],
  "textContent": "After a lot of scouring on google for this exact problem I found an example that may be the solution you are looking for on a sagemaker-examples.\n\nYou need to nest the parameters into another dictionary\n\n\n    hyper_params = {\"max_length\": 30, \"top_k\": 50, \"top_p\": 0.95, \"do_sample\": True}\n    hyper_params_dict = {\"HYPER_PARAMS\": str(hyper_params)}\n\n\nsagemaker-examples.readthedocs.io\n\n### max_length - SageMaker JumpStart Foundation Models - HuggingFace Text2Text...\n\nThis notebook’s CI test result for us-west-2 is as follows. CI test results in other regions can be found at the end of the notebook.",
  "title": "HF Sagemaker Setting LLM Parameters"
}