https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/Head https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://www.nanopub.org/nschema#hasAssertion https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/assertion https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://www.nanopub.org/nschema#hasProvenance https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/provenance https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://www.nanopub.org/nschema#hasPublicationInfo https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/pubinfo https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.nanopub.org/nschema#Nanopublication https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/assertion https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/dc/terms/title VAT-KG: KNOWLEDGE-INTENSIVE MULTIMODAL KNOWLEDGE GRAPH DATASET FOR RETRIEVAL-AUGMENTED GENERATION https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/describes https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/describes https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#gemini2Dot5 https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#gpt4o https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#m2ConceptBase https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#qwen2Dot5Omni https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#videoLlama2 https://doi.org/10.48550/arXiv.2506.21556 http://purl.org/spar/cito/discusses https://neverblink.eu/ontologies/llm-kg/methods#wikidata5M https://doi.org/10.48550/arXiv.2506.21556 http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://www.w3.org/ns/prov#Entity https://neverblink.eu/ontologies/llm-kg/methods#gemini2Dot5 http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#gemini2Dot5 http://www.w3.org/2000/01/rdf-schema#label Gemini-2.5 https://neverblink.eu/ontologies/llm-kg/methods#gpt4o http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#gpt4o http://www.w3.org/2000/01/rdf-schema#label GPT-4o https://neverblink.eu/ontologies/llm-kg/methods#m2ConceptBase http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#m2ConceptBase http://www.w3.org/2000/01/rdf-schema#label M2ConceptBase https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework http://purl.org/dc/terms/subject https://neverblink.eu/ontologies/llm-kg/categories#SynergizedReasoning https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework http://www.w3.org/2000/01/rdf-schema#comment This framework integrates VAT-KG with Multimodal Large Language Models (MLLMs) for question answering across diverse modalities. It synergistically combines retrieval from VAT-KG with MLLM generation and includes a "Retrieval Checker" that uses the MLLM's text encoder to filter retrieved KG triplets, indicating a unified reasoning process where both LLM and KG representations are actively combined. https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework http://www.w3.org/2000/01/rdf-schema#label Multimodal RAG Framework https://neverblink.eu/ontologies/llm-kg/methods#multimodalRagFramework https://neverblink.eu/ontologies/llm-kg/hasTopCategory https://neverblink.eu/ontologies/llm-kg/top-categories#SynergizedLLMKG https://neverblink.eu/ontologies/llm-kg/methods#qwen2Dot5Omni http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#qwen2Dot5Omni http://www.w3.org/2000/01/rdf-schema#label Qwen2.5-Omni https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline http://purl.org/dc/terms/subject https://neverblink.eu/ontologies/llm-kg/categories#LLMAugmentedKGConstruction https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline http://www.w3.org/2000/01/rdf-schema#comment This method proposes a four-step pipeline for constructing the Visual-Audio-Text Knowledge Graph (VAT-KG). It explicitly leverages LLMs for "Knowledge-Intensive Recaptioning" to enrich textual data and "Multimodal Triplet Grounding" to extract knowledge-intensive triplets, directly supporting the construction of the knowledge graph. Thus, LLMs are used to improve a KG task, specifically KG construction. https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline http://www.w3.org/2000/01/rdf-schema#label VAT-KG Construction Pipeline https://neverblink.eu/ontologies/llm-kg/methods#vatkgConstructionPipeline https://neverblink.eu/ontologies/llm-kg/hasTopCategory https://neverblink.eu/ontologies/llm-kg/top-categories#LLMAugmentedKG https://neverblink.eu/ontologies/llm-kg/methods#videoLlama2 http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#videoLlama2 http://www.w3.org/2000/01/rdf-schema#label Video-LLaMA2 https://neverblink.eu/ontologies/llm-kg/methods#wikidata5M http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://purl.org/spar/fabio/Workflow https://neverblink.eu/ontologies/llm-kg/methods#wikidata5M http://www.w3.org/2000/01/rdf-schema#label Wikidata5M https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/provenance https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/assertion http://www.w3.org/ns/prov#wasAttributedTo https://neverblink.eu/ontologies/llm-kg/agent https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/assertion http://www.w3.org/ns/prov#wasDerivedFrom https://doi.org/10.48550/arXiv.2506.21556 https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/pubinfo https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://purl.org/dc/terms/created 2026-02-26T15:44:44.440Z https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://purl.org/dc/terms/creator https://neverblink.eu/ontologies/llm-kg/agent https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://purl.org/nanopub/x/hasNanopubType https://neverblink.eu/ontologies/llm-kg/PaperAssessmentResult https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A http://www.w3.org/2000/01/rdf-schema#label LLM-KG assessment for paper 10.48550/arXiv.2506.21556 https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/sig http://purl.org/nanopub/x/hasAlgorithm RSA https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/sig http://purl.org/nanopub/x/hasPublicKey MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwNz2QK3SEifno78S7+48zUB0xpTex3mAzW73ZimHqNcdEMU5/apslrGrTHGFAt/Chocgo++r6JQp5ygY7NyJHGWdaIqnt85pjX4PbNfLAvapyUO00qZP34fY61w4eZ9UMtleWEsmZKRtQPyJ8ODl46i/rfPuZlcJGpM9Nmy5mpGWuepqIEvF4a/t7pLVeCEDFSYXT+yaiygt6ynIK5f7TtEDhZpeUf/Q74WhMPJXm4yTU/hqOX4IW+50kWHNArGGZwUaXwzyG6M3Zd6UMModryGkLqS4H/MSE3ZA1Ylnms7BfWLEXhMWlaKi6HRV4nGRDLhxVSi9LSRi3LWKLhNIIQIDAQAB https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/sig http://purl.org/nanopub/x/hasSignature OqddnoTeurqKLv5Mku14JsvxdjqJExiHn4ql1dROycCWvq2fO0lrClRvIinPQx8iNULpuxn03UK+4bZ8L/ga38jxrQ9rhm+d2C8cZAQ0XxNtvu2MCKqFxbUeMTYI4SuCeOslm6E4DZ0/yY29WEl7hUxqga/RIhe/OuMU7y46gerkPAaXFQuIbaVpGgDOQQ1Z9kHTFJ0H6Wxbt+opXbsHqNV3ZvkCsucfMQUaSwk8KMkBghFVnmX1AYd94e5F/JhybnRjY10nqYsTx/2ovf++7FOeIox6/54jVcV9+JIzVQDj/ArlOdy20AToMINyGAT0vlHPLU73JBdBuZviB/uSjg== https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/sig http://purl.org/nanopub/x/hasSignatureTarget https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A https://w3id.org/np/RA3rC4HKg3oOEpBkxIDrJ3DQYkPle89M0RRumAdIJFR3A/sig http://purl.org/nanopub/x/signedBy https://neverblink.eu/ontologies/llm-kg/agent