Categories

See More
Popular Forum

MBA (4887) B.Tech (1769) Engineering (1486) Class 12 (1030) Study Abroad (1004) Computer Science and Engineering (988) Business Management Studies (865) BBA (846) Diploma (746) CAT (651) B.Com (648) B.Sc (643) JEE Mains (618) Mechanical Engineering (574) Exam (525) India (462) Career (452) All Time Q&A (439) Mass Communication (427) BCA (417) Science (384) Computers & IT (Non-Engg) (383) Medicine & Health Sciences (381) Hotel Management (373) Civil Engineering (353) MCA (349) Tuteehub Top Questions (348) Distance (340) Colleges in India (334)
See More

Evaluate a ranking algorithm [closed]

General Tech Bugs & Fixes

Max. 2000 characters
Tuteehub
Replies

usr_profile.png

User

( 7 months ago )

I'm working on an algorithm to rank nodes in a directed graph. My goal is to detect the most important node bases on its centricity on the graph.

My problem is: How to evaluate and judge the correction of my algorithm? How can I have a ground truth? I can compare my results with PageRank or HIST algorithms. However, they are not a ground truth.

Any suggestion?

usr_profile.png

User

( 7 months ago )

The correctness cannot be evaluated because there is no ground truth.

The algorithm performs a mathematically well-defined computation. Every computer / person in the world will come to the same result when given the same inputs.

The concept of 'importance' is a not-so-well-defined human / social variable which could vary due to population demographics like country, user age groups, gender, race, time, economics etc. There could be multiple meanings and results for this concept based on whom you ask and when.

It is, in general, tough to correlate a mathematical concept with a social concept. Hence the correctness can only be guessed by sociological means.

As you say, you could compare your model to other mathematical models such as Pagerank and they also correspond to an approximation of importance.

what's your interest


forum_ban8_5d8c5fd7cf6f7.gif