This talk demonstrates how to efficiently Knowledge Graphs Construction using Small Language Models like Llama-3.2-3B, showing practical techniques for extracting structured knowledge from JSON and PDF sources through strategic prompting and LLM-based agents. By breaking down complex tasks and orchestrating these lighter models, we achieve robust knowledge extraction while maintaining low computational costs and ensuring privacy.