Learning from High-Degree Entities for Knowledge Graph Modeling

Knowledge base (KB) completion aims to infer missing facts based on existing ones in a KB. Many approaches firstly suppose that the constituents themselves (e.g., head, tail entity and relation) of a fact meet some formulas and then minimize the loss of formula to obtain the feature vectors of entities and relations. Due to the sparsity of KB, some methods also take into consideration the indirect relations between entities. However, indirect relations further widen the differences of training times of high-degree entities (entities linking by many relations) and low-degree entities. This results in underfitting of low-degree entities. In this paper, we propose the path-based TransE with aggregation (PTransE-ag) to fine-tune the feature vector of an entity by comparing it to its related entities that linked by the same relations. In this way, low-degree entities can draw useful information from high-degree entities to directly adjust their representations. Conversely, the overfitting of high-degree entities can be relieved. Extensive experiments carried on the real world dataset show our method can define entities more accurately, and inferring is more effectively than in previous methods.