Settings for LocalAI #150

WeblinxIT · 2024-05-25T11:03:39Z

WeblinxIT
May 25, 2024

Hi,
how can I configure localAI to use this model? Since I am already running localAI I dont want to host another app parallel to localAI.

Thanks and best regards!

nagydavid · 2024-06-08T18:36:59Z

nagydavid
Jun 8, 2024

I would like to also ask for a help

0 replies

acon96 · 2024-06-08T22:00:58Z

acon96
Jun 8, 2024
Maintainer

The "Generic OpenAI Compatible API" backend is compatible with the LocalAI API

5 replies

maxi1134 Jun 17, 2024

The "Generic OpenAI Compatible API" backend is compatible with the LocalAI API

This is correct!
But unfortunately, when using the "Home-3B-v3.q5_k_m" model within LocalAI, the output is more than unusable.

A few examples here:

And here:

And here are the LocalAI Logs when running "Home-3B-v3.q5_k_m" and calling it.

4:28PM DBG Request received: {"model":"Home-3B-v3.q5_k_m","language":"","n":0,"top_p":1,"top_k":null,"temperature":0.1,"max_tokens":128,"echo":false,"batch":0,"ignore_eos":false,"repeat_penalty":0,"n_keep":0,"frequency_penalty":0,"presence_penalty":0,"tfz":null,"typical_p":null,"seed":null,"negative_prompt":"","rope_freq_base":0,"rope_freq_scale":0,"negative_prompt_scale":0,"use_fast_tokenizer":false,"clip_skip":0,"tokenizer":"","file":"","response_format":{},"size":"","prompt":"\u003c|im_start|\u003esystem\nYou are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed with the information provided only.\nThe current time and date is 04:28 PM on Monday June 17, 2024\nServices: switch.turn_off(), switch.turn_on(), switch.toggle(), climate.turn_on(), climate.turn_off(), climate.toggle(), climate.set_hvac_mode(hvac_mode), climate.set_preset_mode(preset_mode), climate.set_aux_heat(), climate.set_temperature(hvac_mode,temperature), climate.set_humidity(humidity), climate.set_fan_mode(fan_mode), climate.set_swing_mode(), input_boolean.reload(), input_boolean.turn_on(), input_boolean.turn_off(), input_boolean.toggle(), light.turn_on(rgb_color,brightness), light.turn_off(), light.toggle(rgb_color,brightness), todo.add_item(item), todo.update_item(item), todo.remove_item(item), todo.get_items(), todo.remove_completed_items(), person.reload(), media_player.turn_on(), media_player.turn_off(), media_player.toggle(), media_player.volume_up(), media_player.volume_down(), media_player.media_play_pause(), media_player.media_play(), media_player.media_pause(), media_player.media_stop(), media_player.media_next_track(), media_player.media_previous_track(), media_player.clear_playlist(), media_player.volume_set(), media_player.volume_mute(), media_player.media_seek(), media_player.join(), media_player.select_source(), media_player.select_sound_mode(), media_player.play_media(), media_player.shuffle_set(), media_player.unjoin(), media_player.repeat_set(), script.reload(), script.turn_on(), script.turn_off(), script.toggle(), vacuum.start(), vacuum.pause(), vacuum.return_to_base(), vacuum.clean_spot(), vacuum.locate(), vacuum.stop(), vacuum.set_fan_speed(), vacuum.send_command(), cover.open_cover(), cover.close_cover(), cover.set_cover_position(), cover.stop_cover(), cover.toggle(), cover.open_cover_tilt(), cover.close_cover_tilt(), cover.stop_cover_tilt(), cover.set_cover_tilt_position(), cover.toggle_cover_tilt()\nDevices:\nperson.maximiliano 'Maxi' = home\nperson.maximiliano 'Maximiliano' = home\nperson.myriam 'Myriam' = unknown\nperson.carla 'Carla' = unknown\nperson.fay 'Fay' = unknown\nperson.cindy 'Cindy' = unknown\nbinary_sensor.motion_home 'Motion Home' = on\nbinary_sensor.all_present_sleeping 'All Present Sleeping' = off\nbinary_sensor.maxi_is_talking 'maxi is talking' = off\nsensor.playing_on_bedroom_speaker 'Playing on Bedroom Speaker' = \nsensor.playing_on_home_group_speaker 'Playing on home group Speaker' = You've Got The Love  -  Lungs by Florence + The Machine\nsensor.maxis_current_game 'Maxis Current Game' = idle\nsensor.amount_partners_home 'amount partners home' = 0 partners\nsensor.amount_friends_home 'amount friends home' = 0 friends\nsensor.which_friends_home 'which friends home' = []\nsensor.amount_people_home 'amount people home' = 0 person(s)\nsensor.total_amount_people_home 'total amount people home' = 1\nsensor.total_amount_people_home 'Total Amount of people at home' = 1\nsensor.last_active_room 'last active room' = office\nsensor.active_sleeper_rooms 'active_sleeper_rooms' = []\nsensor.active_sleeper_amount 'active_sleeper_amount' = 0\nsensor.active_chromecast_rooms 'active_chromecast_rooms' = []\nsensor.active_speakers_rooms 'active_speakers_rooms' = ['office', 'chillingroom', 'hallway', 'kitchen', 'hotbox_top', 'livingroom', 'server', 'bathroom', 'hotbox_down']\nsensor.is_maxi_asleep 'Is maxi asleep?' = awake\nsensor.maxi_current_activity 'Maxi current Activity' = Using the computer\nsensor.maxi_location_v3 'Maxi Location v3' = office\nsensor.maxi_location_v3 'Location of maxi' = office\nsensor.maxi_location_v3 'Maxi's Location' = office\ninput_boolean.acid_time 'Acid Time' = off\ninput_boolean.acid_time 'Acid Time.' = off\ninput_boolean.acid_time 'Acid Mode' = off\ninput_boolean.waiting_pakidge 'Waiting Pakidge' = off\ninput_boolean.waiting_pakidge 'Waiting for Packages' = off\ninput_boolean.waiting_pakidge 'Waiting Package' = off\ninput_boolean.waiting_pakidge 'Waiting for Package' = off\ninput_boolean.waiting_pakidge 'Waiting Packages' = off\nmedia_player.universal_office_speakers 'Universal Office Speakers' = playing;You've Got The Love;vol=50\nmedia_player.universal_office_speakers 'Office Speakers' = playing;You've Got The Love;vol=50\nmedia_player.universal_livingroom_speakers 'Universal Livingroom Speakers' = playing;You've Got The Love;vol=52\nmedia_player.universal_kitchen_speakers 'Universal kitchen Speakers' = playing;You've Got The Love;vol=47\nmedia_player.universal_hotbox_top_speakers 'Universal hotbox top Speakers' = playing;You've Got The Love;vol=80\nmedia_player.universal_hotbox_down_speakers 'Universal hotbox down Speakers' = playing;You've Got The Love;vol=47\nmedia_player.universal_chillingroom_speakers 'Universal Chillingroom Speakers' = playing;You've Got The Love;vol=40\nmedia_player.universal_hallway_speakers 'Universal Hallway Speakers' = playing;You've Got The Love;vol=48\nmedia_player.universal_office_chromecast 'Universal office chromecast' = off\nmedia_player.universal_hotbox_down_chromecast 'Universal hotbox down chromecast' = off\nmedia_player.universal_hotbox_top_chromecast 'Universal hotbox top chromecast' = off\nmedia_player.universal_patio_chromecast 'Universal patio chromecast' = off\nmedia_player.universal_livingroom_chromecast 'Universal livingroom chromecast' = off\nlight.group_hotbox_lights 'Group Hotbox Lights' = off\nlight.group_hotbox_lights 'Hotbox Lights' = off\nlight.group_bedroom_lights 'Group Bedroom Lights' = off\nlight.group_bedroom_lights 'Bedroom Lights' = off\nlight.group_hotbox_down_lights 'group_hotbox_down_lights' = off\nlight.group_hotbox_down_lights 'Hot box down Lights' = off\nlight.group_hotbox_down_lights 'Hotbox Down Lights' = off\nlight.group_office_lights 'group_office_lights' = on;sandybrown (255, 176, 108);100%\nlight.group_office_lights 'Office Lights' = on;sandybrown (255, 176, 108);100%\nlight.group_chillingroom_lights 'group_chillingroom_lights' = on;sandybrown (255, 176, 108);100%\nlight.group_chillingroom_lights 'Chilling room Lights' = on;sandybrown (255, 176, 108);100%\nlight.group_chillingroom_lights 'Chillingroom lights' = on;sandybrown (255, 176, 108);100%\nlight.group_all_inside_lights 'All inside lights' = on;sandybrown (255, 176, 108);100%\nlight.group_all_inside_lights 'Inside Lights' = on;sandybrown (255, 176, 108);100%\nlight.group_all_inside_lights 'All Inside Lights' = on;sandybrown (255, 176, 108);100%\nlight.group_all_inside_lights 'All the inside lights' = on;sandybrown (255, 176, 108);100%\nlight.group_closet_lights 'Group Closet Lights' = off\nlight.group_closet_lights 'Closet Lights' = off\nlight.group_kitchen_lights 'group_kitchen_lights' = off\nlight.group_kitchen_lights 'Kitchen Lights' = off\nlight.group_bathroom_lights 'group_bathroom_lights' = off\nlight.group_bathroom_lights 'Bathroom Lights' = off\nlight.group_server_lights 'group_server_lights' = off\nlight.group_server_lights 'Server Lights' = off\nlight.group_livingroom_lights 'group_livingroom_lights' = off\nlight.group_livingroom_lights 'Living room Lights' = off\nlight.group_livingroom_lights 'Livingroom Lights' = off\nlight.group_entrance_lights 'group_entrance_lights' = off\nlight.group_entrance_lights 'Entrance Lights' = off\nlight.group_hallway_lights 'group_hallway_lights' = off\nlight.group_hallway_lights 'Hallway Lights' = off\nlight.group_hotbox_top_lights 'group_hotbox_top_lights' = off\nlight.group_hotbox_top_lights 'Hotbox top Lights' = off\nlight.group_hotbox_top_lights 'Hot Box top Lights' = off\nlight.group_patio_lights 'Group Patio Lights' = off\nlight.group_patio_lights 'Patio Lights' = off\ncover.group_all_blinds 'group_all_blinds' = open\ncover.group_all_blinds 'all blinds' = open\ncover.group_all_blinds 'all the blinds' = open\ncover.group_all_blinds 'all the windows' = open\ncover.group_all_blinds 'all windows' = open\nlight.plug_kitchen_uv_lamp 'plug_kitchen_uv_lamp' = off\nlight.hotbox_down_lavalamp_2 'Hotbox_Down_lavaLamp' = unavailable\nclimate.hotbox_ac 'Hotbox Thermostat' = cool;23C\nclimate.office_ac 'Office Thermostat' = cool;23C\nclimate.livingroom_ac 'Livingroom Thermostat' = cool;23C\nclimate.bedroom_ac 'Bedroom Thermostat' = cool;23C\nswitch.hallway_tablet_screensaver 'Hallway Tablet Screensaver' = off\nswitch.hallway_tablet_screen 'Hallway Tablet Screen' = on\nswitch.kitchen_tablet_screensaver 'Kitchen Tablet Screensaver' = off\nswitch.kitchen_tablet_screen 'Kitchen Tablet Screen' = on\nvacuum.xiaomi_vacuum_cleaner 'Roborock S6 Pure' = docked\nscript.broadcast_alert_in_the_house 'important broadcast alert in the house' = off\nscript.change_received_lights_to_random_colors 'Change received lights to random color' = off\nscript.start_playlist_on_all_chromecasts 'Start requsted Playlist on plex for all unplaying chromecasts' = off\nscript.1714666287611 'non-important broadcast alert in the house' = off\nscript.changes_all_on 'Changes all on lights to random colors' = off\nscript.1714667687332 'Changes all on lights to random pastel colors' = off\nscript.generate_and_save_localai_image 'Generate and save LocalAI image' = off\nscript.generate_and_save_sd_image 'Generate and save SD image' = off\nscript.changes_all_on_lights_to_warm_colors 'Changes all on lights to warm colors' = off\nscript.1716330781093 'Changes all on lights to warm pale colors' = off\nscript.generate_fake_white_colors 'Generate fake white colors' = off\nscript.in_home_defense_script 'All on defense script' = off\nscript.changes_all_on_lights_to_fake_white 'Changes all on lights to fake white' = off\nscript.inside_only_home_defense_script 'Inside only home defense script' = off\nbinary_sensor.front_door_camera_motion 'Front Door Camera Motion' = on\nbinary_sensor.faceshot_camera_motion 'Faceshot Camera Motion' = on\nbinary_sensor.patio_camera_motion 'Patio Camera Motion' = on\nbinary_sensor.back_door_camera_motion 'Back Door Camera Motion' = on\nswitch.bathroom_fan 'Bathroom Fan' = off\ntodo.chillings_google_calendar_import 'Chillings (google calendar import)' = 0\ntodo.censored'[email protected] (google calendar import)' = 0\ntodo.censored'censored.censored%40gmail.com+%28google+calendar+import%29' = 0\nlight.office_lamp2_light 'office_lamp2_light' = on;sandybrown (255, 176, 108);100%\nlight.chillingroom_christmas_tree_light 'Christmas Tree' = off\nlight.chillingroom_christmas_tree_light 'The Tree' = off\nlight.chillingroom_christmas_tree_light 'Christmas Tree' = off\nsensor.weather_montreal_dew_point 'Weather Montreal Dew point' = 15.7 °C\nsensor.weather_montreal_high_temperature 'Weather Montreal High temperature' = 31 °C\nsensor.weather_montreal_humidex 'Weather Montreal Humidex' = 28 °C\nsensor.weather_montreal_humidity 'Weather Montreal Humidity' = 63 %\nsensor.weather_montreal_low_temperature 'Weather Montreal Low temperature' = 22 °C\nsensor.weather_montreal_normal_high_temperature 'Weather Montreal Normal high temperature' = 24 °C\nsensor.weather_montreal_normal_low_temperature 'Weather Montreal Normal low temperature' = 13 °C\nsensor.weather_montreal_temperature 'Weather Montreal Temperature' = 23.2 °C\nsensor.weather_montreal_wind_chill 'Weather Montreal Wind chill' = unknown °C\nsensor.weather_montreal_aqhi 'Weather Montreal AQHI' = 2\nsensor.sensor_livingroom_temperature_temperature 'Livingroom Temperature' = 22.7 °C;22C;46.5%\nsensor.sensor_livingroom_temperature_humidity 'Livingroom Humidity' = 46.5 %;22C;46.5%\nsensor.sensor_outside_temperature_temperature 'Outside Temperature' = 22.45 °C;22C;67.62%\nsensor.sensor_outside_temperature_humidity 'Outside Humidity' = 67.62 %;22C;67.62%\nsensor.sensor_hotbox_down_temperature_temperature 'Hotbox Temperature' = 23.6 °C;23C;38.6%\nsensor.sensor_hotbox_down_temperature_humidity 'Hotbox Humidity' = 38.6 %;23C;38.6%\nsensor.sensor_closet_temperature_temperature 'Closet Temperature' = 23.64 °C;23C;52.46%\nsensor.sensor_closet_temperature_humidity 'Closet Humidity' = 52.46 %;23C;52.46%\nsensor.sensor_bathroom_temperature_temperature 'Bathroom Temperature' = 24.3 °C;24C;48.1%\nsensor.sensor_bathroom_temperature_humidity 'Bathroom Humidity' = 48.1 %;24C;48.1%\nsensor.sensor_bedroom_temperature_temperature 'Bedroom Temperature' = 22.31 °C;22C;63.12%\nsensor.sensor_bedroom_temperature_humidity 'Bedroom Humidity' = 63.12 %;22C;63.12%\nbinary_sensor.sensor_workstation_motion_occupancy 'Workstation Motion_occupancy' = off;35C\nbinary_sensor.sensor_hotbox_top_motion_occupancy 'Hotbox Top Motion_occupancy' = off;31C\nbinary_sensor.sensor_kitchen_motion_occupancy 'Kitchen Motion_occupancy' = off\nbinary_sensor.sensor_bathroom_motion_occupancy 'Bathroom Motion occupancy' = off;29C\nbinary_sensor.sensor_livingroom_motion_occupancy 'Livingroom Motion_occupancy' = off\nbinary_sensor.sensor_entrance_motion_occupancy 'sensor_entrance_motion Motion' = off;28C\nbinary_sensor.sensor_hallway_motion_occupancy 'Hallway Motion_occupancy' = off\nbinary_sensor.sensor_bedroom_motion_occupancy 'Bedroom Motion' = off\nbinary_sensor.sensor_chillingroom_motion_occupancy 'ChillingRoom Motion occupancy' = off\nbinary_sensor.sensor_server_motion_occupancy 'sensor_server_motion Motion' = off;7C\nbinary_sensor.sensor_hotbox_down_motion_occupancy 'Hotbox Down Motion_occupancy' = off\nbinary_sensor.sensor_closet_motion_occupancy 'Closet Motion_occupancy' = off\nbinary_sensor.sensor_hotbox_top_couch_motion_occupancy 'hotbox_top_couch_motion_occupancy' = off\nbinary_sensor.sensor_office_motion_occupancy 'sensor_office_motion Motion' = off\nbinary_sensor.sensor_front_door_contact 'Front Door' = off\nbinary_sensor.sensor_front_outside_door_contact 'Front Outside Door' = off\nbinary_sensor.sensor_hotbox_down_entry_motion_occupancy 'sensor_hotbox_down_entry_motion Motion' = off\nbinary_sensor.sensor_closet_fp1_presence 'Sensor_Closet_FP1 Presence' = off;21C\nbinary_sensor.sensor_patio_motion_occupancy 'sensor_patio_motion Motion' = off\nbinary_sensor.sensor_bathroom_door_contact 'Bathroom Door' = on\ncover.cover_livingroom_blinds 'Living room blinds' = open\ncover.cover_livingroom_blinds 'Living room Window' = open\ncover.cover_livingroom_blinds 'Living room Blinds' = open\ncover.cover_livingroom_blinds 'Living room Blind' = open\ncover.cover_livingroom_blinds 'Livingroom Blind' = open\ncover.cover_livingroom_blinds 'Livingroom Blinds' = open\ncover.cover_office_blinds 'Office Blind' = open\ncover.cover_office_blinds 'Office Blind' = open\ncover.cover_office_blinds 'Office Window' = open\ncover.cover_office_blinds 'Office Blinds' = open\ncover.cover_office_blinds 'Office Curtains' = open\ncover.cover_office_blinds 'Office curtain' = open\nmedia_player.mass_home_group 'Home group' = playing;You've Got The Love;vol=0\nmedia_player.mass_closet_wiim_speaker 'Closet Wiim' = off\nbinary_sensor.maxi_is_listening 'maxi is listening' = unavailable\nbinary_sensor.f9432d25_5b487528 'f9432d25-5b487528' = off\u003c|im_end|\u003e\n\u003c|im_start|\u003euser\nStop the music \u003c|im_end|\u003e\n\u003c|im_start|\u003eassistant","instruction":"","input":null,"stop":null,"messages":null,"functions":null,"function_call":null,"stream":false,"mode":0,"step":0,"grammar":"","grammar_json_functions":null,"grammar_json_name":null,"backend":"","model_base_name":""}
4:28PM DBG `input`: &{PredictionOptions:{Model:Home-3B-v3.q5_k_m Language: N:0 TopP:0xc000c81850 TopK:<nil> Temperature:0xc000c81848 Maxtokens:0xc000c81840 Echo:false Batch:0 IgnoreEOS:false RepeatPenalty:0 Keep:0 FrequencyPenalty:0 PresencePenalty:0 TFZ:<nil> TypicalP:<nil> Seed:<nil> NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Context:context.Background.WithCancel Cancel:0x4cef60 File: ResponseFormat:{Type:} Size: Prompt:<|im_start|>system
You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed with the information provided only.
The current time and date is 04:28 PM on Monday June 17, 2024
Services: switch.turn_off(), switch.turn_on(), switch.toggle(), climate.turn_on(), climate.turn_off(), climate.toggle(), climate.set_hvac_mode(hvac_mode), climate.set_preset_mode(preset_mode), climate.set_aux_heat(), climate.set_temperature(hvac_mode,temperature), climate.set_humidity(humidity), climate.set_fan_mode(fan_mode), climate.set_swing_mode(), input_boolean.reload(), input_boolean.turn_on(), input_boolean.turn_off(), input_boolean.toggle(), light.turn_on(rgb_color,brightness), light.turn_off(), light.toggle(rgb_color,brightness), todo.add_item(item), todo.update_item(item), todo.remove_item(item), todo.get_items(), todo.remove_completed_items(), person.reload(), media_player.turn_on(), media_player.turn_off(), media_player.toggle(), media_player.volume_up(), media_player.volume_down(), media_player.media_play_pause(), media_player.media_play(), media_player.media_pause(), media_player.media_stop(), media_player.media_next_track(), media_player.media_previous_track(), media_player.clear_playlist(), media_player.volume_set(), media_player.volume_mute(), media_player.media_seek(), media_player.join(), media_player.select_source(), media_player.select_sound_mode(), media_player.play_media(), media_player.shuffle_set(), media_player.unjoin(), media_player.repeat_set(), script.reload(), script.turn_on(), script.turn_off(), script.toggle(), vacuum.start(), vacuum.pause(), vacuum.return_to_base(), vacuum.clean_spot(), vacuum.locate(), vacuum.stop(), vacuum.set_fan_speed(), vacuum.send_command(), cover.open_cover(), cover.close_cover(), cover.set_cover_position(), cover.stop_cover(), cover.toggle(), cover.open_cover_tilt(), cover.close_cover_tilt(), cover.stop_cover_tilt(), cover.set_cover_tilt_position(), cover.toggle_cover_tilt()
Devices:
person.maximiliano 'Maxi' = home
person.maximiliano 'Maximiliano' = home
person.myriam 'Myriam' = unknown
person.carla 'Carla' = unknown
person.fay 'Fay' = unknown
person.cindy 'Cindy' = unknown
binary_sensor.motion_home 'Motion Home' = on
binary_sensor.all_present_sleeping 'All Present Sleeping' = off
binary_sensor.maxi_is_talking 'maxi is talking' = off
sensor.playing_on_bedroom_speaker 'Playing on Bedroom Speaker' =
sensor.playing_on_home_group_speaker 'Playing on home group Speaker' = You've Got The Love  -  Lungs by Florence + The Machine
sensor.maxis_current_game 'Maxis Current Game' = idle
sensor.amount_partners_home 'amount partners home' = 0 partners
sensor.amount_friends_home 'amount friends home' = 0 friends
sensor.which_friends_home 'which friends home' = []
sensor.amount_people_home 'amount people home' = 0 person(s)
sensor.total_amount_people_home 'total amount people home' = 1
sensor.total_amount_people_home 'Total Amount of people at home' = 1
sensor.last_active_room 'last active room' = office
sensor.active_sleeper_rooms 'active_sleeper_rooms' = []
sensor.active_sleeper_amount 'active_sleeper_amount' = 0
sensor.active_chromecast_rooms 'active_chromecast_rooms' = []
sensor.active_speakers_rooms 'active_speakers_rooms' = ['office', 'chillingroom', 'hallway', 'kitchen', 'hotbox_top', 'livingroom', 'server', 'bathroom', 'hotbox_down']
sensor.is_maxi_asleep 'Is maxi asleep?' = awake
sensor.maxi_current_activity 'Maxi current Activity' = Using the computer
sensor.maxi_location_v3 'Maxi Location v3' = office
sensor.maxi_location_v3 'Location of maxi' = office
sensor.maxi_location_v3 'Maxi's Location' = office
input_boolean.acid_time 'Acid Time' = off
input_boolean.acid_time 'Acid Time.' = off
input_boolean.acid_time 'Acid Mode' = off
input_boolean.waiting_pakidge 'Waiting Pakidge' = off
input_boolean.waiting_pakidge 'Waiting for Packages' = off
input_boolean.waiting_pakidge 'Waiting Package' = off
input_boolean.waiting_pakidge 'Waiting for Package' = off
input_boolean.waiting_pakidge 'Waiting Packages' = off
media_player.universal_office_speakers 'Universal Office Speakers' = playing;You've Got The Love;vol=50
media_player.universal_office_speakers 'Office Speakers' = playing;You've Got The Love;vol=50
media_player.universal_livingroom_speakers 'Universal Livingroom Speakers' = playing;You've Got The Love;vol=52
media_player.universal_kitchen_speakers 'Universal kitchen Speakers' = playing;You've Got The Love;vol=47
media_player.universal_hotbox_top_speakers 'Universal hotbox top Speakers' = playing;You've Got The Love;vol=80
media_player.universal_hotbox_down_speakers 'Universal hotbox down Speakers' = playing;You've Got The Love;vol=47
media_player.universal_chillingroom_speakers 'Universal Chillingroom Speakers' = playing;You've Got The Love;vol=40
media_player.universal_hallway_speakers 'Universal Hallway Speakers' = playing;You've Got The Love;vol=48
media_player.universal_office_chromecast 'Universal office chromecast' = off
media_player.universal_hotbox_down_chromecast 'Universal hotbox down chromecast' = off
media_player.universal_hotbox_top_chromecast 'Universal hotbox top chromecast' = off
media_player.universal_patio_chromecast 'Universal patio chromecast' = off
media_player.universal_livingroom_chromecast 'Universal livingroom chromecast' = off
light.group_hotbox_lights 'Group Hotbox Lights' = off
light.group_hotbox_lights 'Hotbox Lights' = off
light.group_bedroom_lights 'Group Bedroom Lights' = off
light.group_bedroom_lights 'Bedroom Lights' = off
light.group_hotbox_down_lights 'group_hotbox_down_lights' = off
light.group_hotbox_down_lights 'Hot box down Lights' = off
light.group_hotbox_down_lights 'Hotbox Down Lights' = off
light.group_office_lights 'group_office_lights' = on;sandybrown (255, 176, 108);100%
light.group_office_lights 'Office Lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'group_chillingroom_lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'Chilling room Lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'Chillingroom lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All inside lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'Inside Lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All Inside Lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All the inside lights' = on;sandybrown (255, 176, 108);100%
light.group_closet_lights 'Group Closet Lights' = off
light.group_closet_lights 'Closet Lights' = off
light.group_kitchen_lights 'group_kitchen_lights' = off
light.group_kitchen_lights 'Kitchen Lights' = off
light.group_bathroom_lights 'group_bathroom_lights' = off
light.group_bathroom_lights 'Bathroom Lights' = off
light.group_server_lights 'group_server_lights' = off
light.group_server_lights 'Server Lights' = off
light.group_livingroom_lights 'group_livingroom_lights' = off
light.group_livingroom_lights 'Living room Lights' = off
light.group_livingroom_lights 'Livingroom Lights' = off
light.group_entrance_lights 'group_entrance_lights' = off
light.group_entrance_lights 'Entrance Lights' = off
light.group_hallway_lights 'group_hallway_lights' = off
light.group_hallway_lights 'Hallway Lights' = off
light.group_hotbox_top_lights 'group_hotbox_top_lights' = off
light.group_hotbox_top_lights 'Hotbox top Lights' = off
light.group_hotbox_top_lights 'Hot Box top Lights' = off
light.group_patio_lights 'Group Patio Lights' = off
light.group_patio_lights 'Patio Lights' = off
cover.group_all_blinds 'group_all_blinds' = open
cover.group_all_blinds 'all blinds' = open
cover.group_all_blinds 'all the blinds' = open
cover.group_all_blinds 'all the windows' = open
cover.group_all_blinds 'all windows' = open
light.plug_kitchen_uv_lamp 'plug_kitchen_uv_lamp' = off
light.hotbox_down_lavalamp_2 'Hotbox_Down_lavaLamp' = unavailable
climate.hotbox_ac 'Hotbox Thermostat' = cool;23C
climate.office_ac 'Office Thermostat' = cool;23C
climate.livingroom_ac 'Livingroom Thermostat' = cool;23C
climate.bedroom_ac 'Bedroom Thermostat' = cool;23C
switch.hallway_tablet_screensaver 'Hallway Tablet Screensaver' = off
switch.hallway_tablet_screen 'Hallway Tablet Screen' = on
switch.kitchen_tablet_screensaver 'Kitchen Tablet Screensaver' = off
switch.kitchen_tablet_screen 'Kitchen Tablet Screen' = on
vacuum.xiaomi_vacuum_cleaner 'Roborock S6 Pure' = docked
script.broadcast_alert_in_the_house 'important broadcast alert in the house' = off
script.change_received_lights_to_random_colors 'Change received lights to random color' = off
script.start_playlist_on_all_chromecasts 'Start requsted Playlist on plex for all unplaying chromecasts' = off
script.1714666287611 'non-important broadcast alert in the house' = off
script.changes_all_on 'Changes all on lights to random colors' = off
script.1714667687332 'Changes all on lights to random pastel colors' = off
script.generate_and_save_localai_image 'Generate and save LocalAI image' = off
script.generate_and_save_sd_image 'Generate and save SD image' = off
script.changes_all_on_lights_to_warm_colors 'Changes all on lights to warm colors' = off
script.1716330781093 'Changes all on lights to warm pale colors' = off
script.generate_fake_white_colors 'Generate fake white colors' = off
script.in_home_defense_script 'All on defense script' = off
script.changes_all_on_lights_to_fake_white 'Changes all on lights to fake white' = off
script.inside_only_home_defense_script 'Inside only home defense script' = off
binary_sensor.front_door_camera_motion 'Front Door Camera Motion' = on
binary_sensor.faceshot_camera_motion 'Faceshot Camera Motion' = on
binary_sensor.patio_camera_motion 'Patio Camera Motion' = on
binary_sensor.back_door_camera_motion 'Back Door Camera Motion' = on
switch.bathroom_fan 'Bathroom Fan' = off
todo.chillings_google_calendar_import 'Chillings (google calendar import)' = 0
todo.censored'[email protected] (google calendar import)' = 0
todo.censored'censored.censored%40gmail.com+%28google+calendar+import%29' = 0
light.office_lamp2_light 'office_lamp2_light' = on;sandybrown (255, 176, 108);100%
light.chillingroom_christmas_tree_light 'Christmas Tree' = off
light.chillingroom_christmas_tree_light 'The Tree' = off
light.chillingroom_christmas_tree_light 'Christmas Tree' = off
sensor.weather_montreal_dew_point 'Weather Montreal Dew point' = 15.7 °C
sensor.weather_montreal_high_temperature 'Weather Montreal High temperature' = 31 °C
sensor.weather_montreal_humidex 'Weather Montreal Humidex' = 28 °C
sensor.weather_montreal_humidity 'Weather Montreal Humidity' = 63 %
sensor.weather_montreal_low_temperature 'Weather Montreal Low temperature' = 22 °C
sensor.weather_montreal_normal_high_temperature 'Weather Montreal Normal high temperature' = 24 °C
sensor.weather_montreal_normal_low_temperature 'Weather Montreal Normal low temperature' = 13 °C
sensor.weather_montreal_temperature 'Weather Montreal Temperature' = 23.2 °C
sensor.weather_montreal_wind_chill 'Weather Montreal Wind chill' = unknown °C
sensor.weather_montreal_aqhi 'Weather Montreal AQHI' = 2
sensor.sensor_livingroom_temperature_temperature 'Livingroom Temperature' = 22.7 °C;22C;46.5%
sensor.sensor_livingroom_temperature_humidity 'Livingroom Humidity' = 46.5 %;22C;46.5%
sensor.sensor_outside_temperature_temperature 'Outside Temperature' = 22.45 °C;22C;67.62%
sensor.sensor_outside_temperature_humidity 'Outside Humidity' = 67.62 %;22C;67.62%
sensor.sensor_hotbox_down_temperature_temperature 'Hotbox Temperature' = 23.6 °C;23C;38.6%
sensor.sensor_hotbox_down_temperature_humidity 'Hotbox Humidity' = 38.6 %;23C;38.6%
sensor.sensor_closet_temperature_temperature 'Closet Temperature' = 23.64 °C;23C;52.46%
sensor.sensor_closet_temperature_humidity 'Closet Humidity' = 52.46 %;23C;52.46%
sensor.sensor_bathroom_temperature_temperature 'Bathroom Temperature' = 24.3 °C;24C;48.1%
sensor.sensor_bathroom_temperature_humidity 'Bathroom Humidity' = 48.1 %;24C;48.1%
sensor.sensor_bedroom_temperature_temperature 'Bedroom Temperature' = 22.31 °C;22C;63.12%
sensor.sensor_bedroom_temperature_humidity 'Bedroom Humidity' = 63.12 %;22C;63.12%
binary_sensor.sensor_workstation_motion_occupancy 'Workstation Motion_occupancy' = off;35C
binary_sensor.sensor_hotbox_top_motion_occupancy 'Hotbox Top Motion_occupancy' = off;31C
binary_sensor.sensor_kitchen_motion_occupancy 'Kitchen Motion_occupancy' = off
binary_sensor.sensor_bathroom_motion_occupancy 'Bathroom Motion occupancy' = off;29C
binary_sensor.sensor_livingroom_motion_occupancy 'Livingroom Motion_occupancy' = off
binary_sensor.sensor_entrance_motion_occupancy 'sensor_entrance_motion Motion' = off;28C
binary_sensor.sensor_hallway_motion_occupancy 'Hallway Motion_occupancy' = off
binary_sensor.sensor_bedroom_motion_occupancy 'Bedroom Motion' = off
binary_sensor.sensor_chillingroom_motion_occupancy 'ChillingRoom Motion occupancy' = off
binary_sensor.sensor_server_motion_occupancy 'sensor_server_motion Motion' = off;7C
binary_sensor.sensor_hotbox_down_motion_occupancy 'Hotbox Down Motion_occupancy' = off
binary_sensor.sensor_closet_motion_occupancy 'Closet Motion_occupancy' = off
binary_sensor.sensor_hotbox_top_couch_motion_occupancy 'hotbox_top_couch_motion_occupancy' = off
binary_sensor.sensor_office_motion_occupancy 'sensor_office_motion Motion' = off
binary_sensor.sensor_front_door_contact 'Front Door' = off
binary_sensor.sensor_front_outside_door_contact 'Front Outside Door' = off
binary_sensor.sensor_hotbox_down_entry_motion_occupancy 'sensor_hotbox_down_entry_motion Motion' = off
binary_sensor.sensor_closet_fp1_presence 'Sensor_Closet_FP1 Presence' = off;21C
binary_sensor.sensor_patio_motion_occupancy 'sensor_patio_motion Motion' = off
binary_sensor.sensor_bathroom_door_contact 'Bathroom Door' = on
cover.cover_livingroom_blinds 'Living room blinds' = open
cover.cover_livingroom_blinds 'Living room Window' = open
cover.cover_livingroom_blinds 'Living room Blinds' = open
cover.cover_livingroom_blinds 'Living room Blind' = open
cover.cover_livingroom_blinds 'Livingroom Blind' = open
cover.cover_livingroom_blinds 'Livingroom Blinds' = open
cover.cover_office_blinds 'Office Blind' = open
cover.cover_office_blinds 'Office Blind' = open
cover.cover_office_blinds 'Office Window' = open
cover.cover_office_blinds 'Office Blinds' = open
cover.cover_office_blinds 'Office Curtains' = open
cover.cover_office_blinds 'Office curtain' = open
media_player.mass_home_group 'Home group' = playing;You've Got The Love;vol=0
media_player.mass_closet_wiim_speaker 'Closet Wiim' = off
binary_sensor.maxi_is_listening 'maxi is listening' = unavailable
binary_sensor.f9432d25_5b487528 'f9432d25-5b487528' = off<|im_end|>
<|im_start|>user
Stop the music <|im_end|>
<|im_start|>assistant Instruction: Input:<nil> Stop:<nil> Messages:[] Functions:[] FunctionCall:<nil> Tools:[] ToolsChoice:<nil> Stream:false Mode:0 Step:0 Grammar: JSONFunctionGrammarObject:<nil> JSONFunctionGrammarObjectName:<nil> Backend: ModelBaseName:}
4:28PM DBG Parameter Config: &{PredictionOptions:{Model:Home-3B-v3.q5_k_m.gguf Language: N:0 TopP:0xc000c81850 TopK:0xc0005f2ac8 Temperature:0xc000c81848 Maxtokens:0xc000c81840 Echo:false Batch:0 IgnoreEOS:false RepeatPenalty:0 Keep:0 FrequencyPenalty:0 PresencePenalty:0 TFZ:0xc0005f2af8 TypicalP:0xc0005f2af0 Seed:0xc0005f2b18 NegativePrompt: RopeFreqBase:0 RopeFreqScale:0 NegativePromptScale:0 UseFastTokenizer:false ClipSkip:0 Tokenizer:} Name:Home-3B-v3.q5_k_m F16:0xc0005f2ab8 Threads:0xc0005f2ab0 Debug:0xc000c81b60 Roles:map[] Embeddings:false Backend: TemplateConfig:{Chat: ChatMessage: Completion: Edit: Functions: UseTokenizerTemplate:false JoinChatMessagesByCharacter:<nil>} PromptStrings:[<|im_start|>system
You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed with the information provided only.
The current time and date is 04:28 PM on Monday June 17, 2024
Services: switch.turn_off(), switch.turn_on(), switch.toggle(), climate.turn_on(), climate.turn_off(), climate.toggle(), climate.set_hvac_mode(hvac_mode), climate.set_preset_mode(preset_mode), climate.set_aux_heat(), climate.set_temperature(hvac_mode,temperature), climate.set_humidity(humidity), climate.set_fan_mode(fan_mode), climate.set_swing_mode(), input_boolean.reload(), input_boolean.turn_on(), input_boolean.turn_off(), input_boolean.toggle(), light.turn_on(rgb_color,brightness), light.turn_off(), light.toggle(rgb_color,brightness), todo.add_item(item), todo.update_item(item), todo.remove_item(item), todo.get_items(), todo.remove_completed_items(), person.reload(), media_player.turn_on(), media_player.turn_off(), media_player.toggle(), media_player.volume_up(), media_player.volume_down(), media_player.media_play_pause(), media_player.media_play(), media_player.media_pause(), media_player.media_stop(), media_player.media_next_track(), media_player.media_previous_track(), media_player.clear_playlist(), media_player.volume_set(), media_player.volume_mute(), media_player.media_seek(), media_player.join(), media_player.select_source(), media_player.select_sound_mode(), media_player.play_media(), media_player.shuffle_set(), media_player.unjoin(), media_player.repeat_set(), script.reload(), script.turn_on(), script.turn_off(), script.toggle(), vacuum.start(), vacuum.pause(), vacuum.return_to_base(), vacuum.clean_spot(), vacuum.locate(), vacuum.stop(), vacuum.set_fan_speed(), vacuum.send_command(), cover.open_cover(), cover.close_cover(), cover.set_cover_position(), cover.stop_cover(), cover.toggle(), cover.open_cover_tilt(), cover.close_cover_tilt(), cover.stop_cover_tilt(), cover.set_cover_tilt_position(), cover.toggle_cover_tilt()
Devices:
person.maximiliano 'Maxi' = home
person.maximiliano 'Maximiliano' = home
person.myriam 'Myriam' = unknown
person.carla 'Carla' = unknown
person.fay 'Fay' = unknown
person.cindy 'Cindy' = unknown
binary_sensor.motion_home 'Motion Home' = on
binary_sensor.all_present_sleeping 'All Present Sleeping' = off
binary_sensor.maxi_is_talking 'maxi is talking' = off
sensor.playing_on_bedroom_speaker 'Playing on Bedroom Speaker' =
sensor.playing_on_home_group_speaker 'Playing on home group Speaker' = You've Got The Love  -  Lungs by Florence + The Machine
sensor.maxis_current_game 'Maxis Current Game' = idle
sensor.amount_partners_home 'amount partners home' = 0 partners
sensor.amount_friends_home 'amount friends home' = 0 friends
sensor.which_friends_home 'which friends home' = []
sensor.amount_people_home 'amount people home' = 0 person(s)
sensor.total_amount_people_home 'total amount people home' = 1
sensor.total_amount_people_home 'Total Amount of people at home' = 1
sensor.last_active_room 'last active room' = office
sensor.active_sleeper_rooms 'active_sleeper_rooms' = []
sensor.active_sleeper_amount 'active_sleeper_amount' = 0
sensor.active_chromecast_rooms 'active_chromecast_rooms' = []
sensor.active_speakers_rooms 'active_speakers_rooms' = ['office', 'chillingroom', 'hallway', 'kitchen', 'hotbox_top', 'livingroom', 'server', 'bathroom', 'hotbox_down']
sensor.is_maxi_asleep 'Is maxi asleep?' = awake
sensor.maxi_current_activity 'Maxi current Activity' = Using the computer
sensor.maxi_location_v3 'Maxi Location v3' = office
sensor.maxi_location_v3 'Location of maxi' = office
sensor.maxi_location_v3 'Maxi's Location' = office
input_boolean.acid_time 'Acid Time' = off
input_boolean.acid_time 'Acid Time.' = off
input_boolean.acid_time 'Acid Mode' = off
input_boolean.waiting_pakidge 'Waiting Pakidge' = off
input_boolean.waiting_pakidge 'Waiting for Packages' = off
input_boolean.waiting_pakidge 'Waiting Package' = off
input_boolean.waiting_pakidge 'Waiting for Package' = off
input_boolean.waiting_pakidge 'Waiting Packages' = off
media_player.universal_office_speakers 'Universal Office Speakers' = playing;You've Got The Love;vol=50
media_player.universal_office_speakers 'Office Speakers' = playing;You've Got The Love;vol=50
media_player.universal_livingroom_speakers 'Universal Livingroom Speakers' = playing;You've Got The Love;vol=52
media_player.universal_kitchen_speakers 'Universal kitchen Speakers' = playing;You've Got The Love;vol=47
media_player.universal_hotbox_top_speakers 'Universal hotbox top Speakers' = playing;You've Got The Love;vol=80
media_player.universal_hotbox_down_speakers 'Universal hotbox down Speakers' = playing;You've Got The Love;vol=47
media_player.universal_chillingroom_speakers 'Universal Chillingroom Speakers' = playing;You've Got The Love;vol=40
media_player.universal_hallway_speakers 'Universal Hallway Speakers' = playing;You've Got The Love;vol=48
media_player.universal_office_chromecast 'Universal office chromecast' = off
media_player.universal_hotbox_down_chromecast 'Universal hotbox down chromecast' = off
media_player.universal_hotbox_top_chromecast 'Universal hotbox top chromecast' = off
media_player.universal_patio_chromecast 'Universal patio chromecast' = off
media_player.universal_livingroom_chromecast 'Universal livingroom chromecast' = off
light.group_hotbox_lights 'Group Hotbox Lights' = off
light.group_hotbox_lights 'Hotbox Lights' = off
light.group_bedroom_lights 'Group Bedroom Lights' = off
light.group_bedroom_lights 'Bedroom Lights' = off
light.group_hotbox_down_lights 'group_hotbox_down_lights' = off
light.group_hotbox_down_lights 'Hot box down Lights' = off
light.group_hotbox_down_lights 'Hotbox Down Lights' = off
light.group_office_lights 'group_office_lights' = on;sandybrown (255, 176, 108);100%
light.group_office_lights 'Office Lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'group_chillingroom_lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'Chilling room Lights' = on;sandybrown (255, 176, 108);100%
light.group_chillingroom_lights 'Chillingroom lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All inside lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'Inside Lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All Inside Lights' = on;sandybrown (255, 176, 108);100%
light.group_all_inside_lights 'All the inside lights' = on;sandybrown (255, 176, 108);100%
light.group_closet_lights 'Group Closet Lights' = off
light.group_closet_lights 'Closet Lights' = off
light.group_kitchen_lights 'group_kitchen_lights' = off
light.group_kitchen_lights 'Kitchen Lights' = off
light.group_bathroom_lights 'group_bathroom_lights' = off
light.group_bathroom_lights 'Bathroom Lights' = off
light.group_server_lights 'group_server_lights' = off
light.group_server_lights 'Server Lights' = off
light.group_livingroom_lights 'group_livingroom_lights' = off
light.group_livingroom_lights 'Living room Lights' = off
light.group_livingroom_lights 'Livingroom Lights' = off
light.group_entrance_lights 'group_entrance_lights' = off
light.group_entrance_lights 'Entrance Lights' = off
light.group_hallway_lights 'group_hallway_lights' = off
light.group_hallway_lights 'Hallway Lights' = off
light.group_hotbox_top_lights 'group_hotbox_top_lights' = off
light.group_hotbox_top_lights 'Hotbox top Lights' = off
light.group_hotbox_top_lights 'Hot Box top Lights' = off
light.group_patio_lights 'Group Patio Lights' = off
light.group_patio_lights 'Patio Lights' = off
cover.group_all_blinds 'group_all_blinds' = open
cover.group_all_blinds 'all blinds' = open
cover.group_all_blinds 'all the blinds' = open
cover.group_all_blinds 'all the windows' = open
cover.group_all_blinds 'all windows' = open
light.plug_kitchen_uv_lamp 'plug_kitchen_uv_lamp' = off
light.hotbox_down_lavalamp_2 'Hotbox_Down_lavaLamp' = unavailable
climate.hotbox_ac 'Hotbox Thermostat' = cool;23C
climate.office_ac 'Office Thermostat' = cool;23C
climate.livingroom_ac 'Livingroom Thermostat' = cool;23C
climate.bedroom_ac 'Bedroom Thermostat' = cool;23C
switch.hallway_tablet_screensaver 'Hallway Tablet Screensaver' = off
switch.hallway_tablet_screen 'Hallway Tablet Screen' = on
switch.kitchen_tablet_screensaver 'Kitchen Tablet Screensaver' = off
switch.kitchen_tablet_screen 'Kitchen Tablet Screen' = on
vacuum.xiaomi_vacuum_cleaner 'Roborock S6 Pure' = docked
script.broadcast_alert_in_the_house 'important broadcast alert in the house' = off
script.change_received_lights_to_random_colors 'Change received lights to random color' = off
script.start_playlist_on_all_chromecasts 'Start requsted Playlist on plex for all unplaying chromecasts' = off
script.1714666287611 'non-important broadcast alert in the house' = off
script.changes_all_on 'Changes all on lights to random colors' = off
script.1714667687332 'Changes all on lights to random pastel colors' = off
script.generate_and_save_localai_image 'Generate and save LocalAI image' = off
script.generate_and_save_sd_image 'Generate and save SD image' = off
script.changes_all_on_lights_to_warm_colors 'Changes all on lights to warm colors' = off
script.1716330781093 'Changes all on lights to warm pale colors' = off
script.generate_fake_white_colors 'Generate fake white colors' = off
script.in_home_defense_script 'All on defense script' = off
script.changes_all_on_lights_to_fake_white 'Changes all on lights to fake white' = off
script.inside_only_home_defense_script 'Inside only home defense script' = off
binary_sensor.front_door_camera_motion 'Front Door Camera Motion' = on
binary_sensor.faceshot_camera_motion 'Faceshot Camera Motion' = on
binary_sensor.patio_camera_motion 'Patio Camera Motion' = on
binary_sensor.back_door_camera_motion 'Back Door Camera Motion' = on
switch.bathroom_fan 'Bathroom Fan' = off
todo.chillings_google_calendar_import 'Chillings (google calendar import)' = 0
todo.censored'[email protected] (google calendar import)' = 0
todo.censored'censored.censored%40gmail.com+%28google+calendar+import%29' = 0
light.office_lamp2_light 'office_lamp2_light' = on;sandybrown (255, 176, 108);100%
light.chillingroom_christmas_tree_light 'Christmas Tree' = off
light.chillingroom_christmas_tree_light 'The Tree' = off
light.chillingroom_christmas_tree_light 'Christmas Tree' = off
sensor.weather_montreal_dew_point 'Weather Montreal Dew point' = 15.7 °C
sensor.weather_montreal_high_temperature 'Weather Montreal High temperature' = 31 °C
sensor.weather_montreal_humidex 'Weather Montreal Humidex' = 28 °C
sensor.weather_montreal_humidity 'Weather Montreal Humidity' = 63 %
sensor.weather_montreal_low_temperature 'Weather Montreal Low temperature' = 22 °C
sensor.weather_montreal_normal_high_temperature 'Weather Montreal Normal high temperature' = 24 °C
sensor.weather_montreal_normal_low_temperature 'Weather Montreal Normal low temperature' = 13 °C
sensor.weather_montreal_temperature 'Weather Montreal Temperature' = 23.2 °C
sensor.weather_montreal_wind_chill 'Weather Montreal Wind chill' = unknown °C
sensor.weather_montreal_aqhi 'Weather Montreal AQHI' = 2
sensor.sensor_livingroom_temperature_temperature 'Livingroom Temperature' = 22.7 °C;22C;46.5%
sensor.sensor_livingroom_temperature_humidity 'Livingroom Humidity' = 46.5 %;22C;46.5%
sensor.sensor_outside_temperature_temperature 'Outside Temperature' = 22.45 °C;22C;67.62%
sensor.sensor_outside_temperature_humidity 'Outside Humidity' = 67.62 %;22C;67.62%
sensor.sensor_hotbox_down_temperature_temperature 'Hotbox Temperature' = 23.6 °C;23C;38.6%
sensor.sensor_hotbox_down_temperature_humidity 'Hotbox Humidity' = 38.6 %;23C;38.6%
sensor.sensor_closet_temperature_temperature 'Closet Temperature' = 23.64 °C;23C;52.46%
sensor.sensor_closet_temperature_humidity 'Closet Humidity' = 52.46 %;23C;52.46%
sensor.sensor_bathroom_temperature_temperature 'Bathroom Temperature' = 24.3 °C;24C;48.1%
sensor.sensor_bathroom_temperature_humidity 'Bathroom Humidity' = 48.1 %;24C;48.1%
sensor.sensor_bedroom_temperature_temperature 'Bedroom Temperature' = 22.31 °C;22C;63.12%
sensor.sensor_bedroom_temperature_humidity 'Bedroom Humidity' = 63.12 %;22C;63.12%
binary_sensor.sensor_workstation_motion_occupancy 'Workstation Motion_occupancy' = off;35C
binary_sensor.sensor_hotbox_top_motion_occupancy 'Hotbox Top Motion_occupancy' = off;31C
binary_sensor.sensor_kitchen_motion_occupancy 'Kitchen Motion_occupancy' = off
binary_sensor.sensor_bathroom_motion_occupancy 'Bathroom Motion occupancy' = off;29C
binary_sensor.sensor_livingroom_motion_occupancy 'Livingroom Motion_occupancy' = off
binary_sensor.sensor_entrance_motion_occupancy 'sensor_entrance_motion Motion' = off;28C
binary_sensor.sensor_hallway_motion_occupancy 'Hallway Motion_occupancy' = off
binary_sensor.sensor_bedroom_motion_occupancy 'Bedroom Motion' = off
binary_sensor.sensor_chillingroom_motion_occupancy 'ChillingRoom Motion occupancy' = off
binary_sensor.sensor_server_motion_occupancy 'sensor_server_motion Motion' = off;7C
binary_sensor.sensor_hotbox_down_motion_occupancy 'Hotbox Down Motion_occupancy' = off
binary_sensor.sensor_closet_motion_occupancy 'Closet Motion_occupancy' = off
binary_sensor.sensor_hotbox_top_couch_motion_occupancy 'hotbox_top_couch_motion_occupancy' = off
binary_sensor.sensor_office_motion_occupancy 'sensor_office_motion Motion' = off
binary_sensor.sensor_front_door_contact 'Front Door' = off
binary_sensor.sensor_front_outside_door_contact 'Front Outside Door' = off
binary_sensor.sensor_hotbox_down_entry_motion_occupancy 'sensor_hotbox_down_entry_motion Motion' = off
binary_sensor.sensor_closet_fp1_presence 'Sensor_Closet_FP1 Presence' = off;21C
binary_sensor.sensor_patio_motion_occupancy 'sensor_patio_motion Motion' = off
binary_sensor.sensor_bathroom_door_contact 'Bathroom Door' = on
cover.cover_livingroom_blinds 'Living room blinds' = open
cover.cover_livingroom_blinds 'Living room Window' = open
cover.cover_livingroom_blinds 'Living room Blinds' = open
cover.cover_livingroom_blinds 'Living room Blind' = open
cover.cover_livingroom_blinds 'Livingroom Blind' = open
cover.cover_livingroom_blinds 'Livingroom Blinds' = open
cover.cover_office_blinds 'Office Blind' = open
cover.cover_office_blinds 'Office Blind' = open
cover.cover_office_blinds 'Office Window' = open
cover.cover_office_blinds 'Office Blinds' = open
cover.cover_office_blinds 'Office Curtains' = open
cover.cover_office_blinds 'Office curtain' = open
media_player.mass_home_group 'Home group' = playing;You've Got The Love;vol=0
media_player.mass_closet_wiim_speaker 'Closet Wiim' = off
binary_sensor.maxi_is_listening 'maxi is listening' = unavailable
binary_sensor.f9432d25_5b487528 'f9432d25-5b487528' = off<|im_end|>
<|im_start|>user
Stop the music <|im_end|>
<|im_start|>assistant] InputStrings:[] InputToken:[] functionCallString: functionCallNameString: FunctionsConfig:{DisableNoAction:false GrammarConfig:{ParallelCalls:false DisableParallelNewLines:false MixedMode:false NoMixedFreeString:false NoGrammar:false Prefix:} NoActionFunctionName: NoActionDescriptionName: ResponseRegex: JSONRegexMatch:[] ReplaceFunctionResults:[] ReplaceLLMResult:[] FunctionName:false} FeatureFlag:map[] LLMConfig:{SystemPrompt: TensorSplit: MainGPU: RMSNormEps:0 NGQA:0 PromptCachePath: PromptCacheAll:false PromptCacheRO:false MirostatETA:0xc0005f2ae8 MirostatTAU:0xc0005f2ae0 Mirostat:0xc0005f2ad8 NGPULayers:0xc0005f2b08 MMap:0xc0005f2aa0 MMlock:0xc0005f2b11 LowVRAM:0xc0005f2b11 Grammar: StopWords:[] Cutstrings:[] TrimSpace:[] TrimSuffix:[] ContextSize:0xc0005f2a90 NUMA:false LoraAdapter: LoraBase: LoraScale:0 NoMulMatQ:false DraftModel: NDraft:0 Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 MMProj: FlashAttention:false NoKVOffloading:false RopeScaling: ModelType: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0} AutoGPTQ:{ModelBaseName: Device: Triton:false UseFastTokenizer:false} Diffusers:{CUDA:false PipelineType: SchedulerType: EnableParameters: CFGScale:0 IMG2IMG:false ClipSkip:0 ClipModel: ClipSubFolder: ControlNet:} Step:0 GRPC:{Attempts:0 AttemptsSleepTime:0} VallE:{AudioPath:} CUDA:false DownloadFiles:[] Description: Usage:}
4:28PM DBG Model already loaded in memory: Home-3B-v3.q5_k_m.gguf
4:28PM DBG Model 'Home-3B-v3.q5_k_m.gguf' already loaded
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641733,"level":"INFO","function":"launch_slot_with_data","line":884,"message":"slot is processing task","slot_id":0,"task_id":130}
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641733,"level":"INFO","function":"update_slots","line":1783,"message":"kv cache rm [p0, end)","slot_id":0,"task_id":130,"p0":0}
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641735,"level":"INFO","function":"print_timings","line":327,"message":"prompt eval time     =    1166.30 ms /  5246 tokens (    0.22 ms per token,  4497.98 tokens per second)","slot_id":0,"task_id":130,"t_prompt_processing":1166.302,"num_prompt_tokens_processed":5246,"t_token":0.22232215020968354,"n_tokens_second":4497.977367782959}
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641735,"level":"INFO","function":"print_timings","line":341,"message":"generation eval time =    1476.53 ms /   128 runs   (   11.54 ms per token,    86.69 tokens per second)","slot_id":0,"task_id":130,"t_token_generation":1476.528,"n_decoded":128,"t_token":11.535375,"n_tokens_second":86.68985620320102}
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641735,"level":"INFO","function":"print_timings","line":351,"message":"          total time =    2642.83 ms","slot_id":0,"task_id":130,"t_prompt_processing":1166.302,"t_token_generation":1476.528,"t_total":2642.83}
4:28PM DBG GRPC(Home-3B-v3.q5_k_m.gguf-127.0.0.1:42719): stdout {"timestamp":1718641735,"level":"INFO","function":"update_slots","line":1594,"message":"slot released","slot_id":0,"task_id":130,"n_ctx":8192,"n_past":5373,"n_system_tokens":0,"n_cache_tokens":5374,"truncated":false}
4:28PM DBG Response: {"created":1718586842,"object":"text_completion","id":"33d61b57-3338-462c-aff0-760f2c375bf6","model":"Home-3B-v3.q5_k_m","choices":[{"index":0,"finish_reason":"stop","text":",,,_,,,,,_,(,,,.__,,,,,,__,,,,,,,,,_,,,,____,,,,__room,,,:::::::::......_,_,_,,,,____,,,,,__,.......,,,,,_,._,,,,off_off_off,,,_,_,,,,off(,"}],"usage":{"prompt_tokens":5246,"completion_tokens":128,"total_tokens":5374}}
4:28PM INF Success ip=192.168.0.15 latency=2.64801701s method=POST status=200 url=/v1/completions

Thanks for reading!

allenporter Jun 18, 2024

Have you specified a chat format? (zephyr)

acon96 Jun 18, 2024
Maintainer

That's a lot of entities exposed. If I had to guess: what is likely happening is that you are using too much context space for the model, which causes the model to get confused about what is going on and output gibberish.

You might have better luck using a model that is natively 16k or 32k context length and configuring In-Context-Learning with the model.

maxi1134 Jun 18, 2024

That's a lot of entities exposed. If I had to guess: what is likely happening is that you are using too much context space for the model, which causes the model to get confused about what is going on and output gibberish.

You might have better luck using a model that is natively 16k or 32k context length and configuring In-Context-Learning with the model.>

I switched to Mistral 7b instruct v0.3 and it works okay. I was hoping to reduce inference time by using a 1b/3b model!

Thanks for the answer!

maxi1134 Jun 19, 2024

That's a lot of entities exposed. If I had to guess: what is likely happening is that you are using too much context space for the model, which causes the model to get confused about what is going on and output gibberish.

You might have better luck using a model that is natively 16k or 32k context length and configuring In-Context-Learning with the model.>

I switched to Mistral 7b instruct v0.3 and it works okay. I was hoping to reduce inference time by using a 1b/3b model!

Thanks for the answer!

It worked perfectly for a few hours and I now get bad answers and no actions issues.
Any idea what this could be?

Llama3 gives me the right commands but they are not acted upon:

WeblinxIT · 2024-06-10T14:54:42Z

WeblinxIT
Jun 10, 2024
Author

But how can I load the model to LocalAI? For me it doesnt work with llama.cpp

Best regards

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Settings for LocalAI #150

{{title}}

Replies: 3 comments 5 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Settings for LocalAI #150

WeblinxIT May 25, 2024

Replies: 3 comments · 5 replies

nagydavid Jun 8, 2024

acon96 Jun 8, 2024 Maintainer

maxi1134 Jun 17, 2024

allenporter Jun 18, 2024

acon96 Jun 18, 2024 Maintainer

maxi1134 Jun 18, 2024

maxi1134 Jun 19, 2024

WeblinxIT Jun 10, 2024 Author

WeblinxIT
May 25, 2024

Replies: 3 comments 5 replies

nagydavid
Jun 8, 2024

acon96
Jun 8, 2024
Maintainer

acon96 Jun 18, 2024
Maintainer

WeblinxIT
Jun 10, 2024
Author