from Hacker News

Triplebyte Raises $10M from Initialized Capital, Marissa Mayer and Paul Graham

by kwi on 2/28/18, 7:00 PM with 175 comments

  • by tway12 on 2/28/18, 8:32 PM

    Unfortunately, my experience with TripleByte was terrible and a waste of my time. I completed the interview with a very high evaluation across all categories as provided by the interviewer.

    There were certain areas where the interviewer messed up in their evaluation, e.g. they felt I "was a little weak at hashmaps and API design", which is probably because they did not know what I was talking about when I described the details of advanced hashmap implementations. There seems to be a bias to discredit the interviewee if the interviewer lacks knowledge in an area.

    Either way, despite getting great evaluations, I was matched with a total of 5 companies most of which were highly underwhelming early stage companies with minimal traction. Furthermore, I was matched with full stack companies despite begin evaluated as "weak in API design", which is perplexing. I was able to get higher quality offers in my own search and it seems like the TripleByte pipeline consists of many mediocre companies.

    If I had known, I wouldn't have wasted my time with this service and invested more time in my job search.

  • by Harj on 2/28/18, 7:43 PM

    What was always most interesting to us about starting a recruiting company was seeing what would happen if you treated hiring as a data problem. Partly we've raised more funding for the same reason any startup does, so we can grow faster to get more customers = more revenue = more success, etc. But we're also driven by how the larger the scale we operate at, the faster we can run experiments to answer questions about the best way to evaluate technical skills. More rigorous and data focused approaches to hiring benefit everyone.

    Interviewing and evaluating engineers is an area a lot of people feel passionately about and have strong opinions on. We're continually looking for ways to improve our process, if you've any thoughts or feedback please ping me - harj at triplebyte.

  • by lettergram on 2/28/18, 11:52 PM

    My interactions with Triplebyte have been less than good and honestly am concerned about the company as a whole (perhaps my thoughts are misplaced).

    In a prior conversation on HN (link below), I brought up some aspect of my interview (interviewer late, argumentative, smug, etc.). Then the interviewer came on to HN and PUBLICLY SHARED PORTIONS OF MY INTERVIEW. Honestly, should have been fired on the spot, but nope.

    To the interviewers credit, after I was the number one comment for most of the day he deleted that portion of the comment. I am grateful (looking back now) that was removed, however I think it speaks volumes.

    The prior discussion is here:

    https://news.ycombinator.com/item?id=13830444

    My two cents, is the idea is good - there is some room for improvement. What's scary is putting one company as a wall between you and the employer. I hope it never comes to pass where they control even 5% of the market. No one should be able to interview better than the company itself and employees shouldn't use a service which upon being declined blocks them from other companies. I don't believe that's the case (yet), so no qualms for the time being.

    Given my experience, I hope they've improved and would happily change my view if I had reason to.

    EDIT: Added prior interaction for reference

  • by mrnobody_67 on 2/28/18, 7:41 PM

    $50m in job offers last 6 months at $130,000 average salary, with 70% of job offers being accepted/signed = 267 people got hired in the past 180 days after completing roughly 30,000 interviews (based on the 5000/month quoted in the article).

    That means the chances of being hired after doing a TripleByte interview is slightly under 1% if my back of the napkin calculation is accurate.

  • by dilatedmind on 2/28/18, 9:31 PM

    My experience with triplebyte was positive, but the interviews with the companies I matched with was not.

    The first thing every company asked for was my resume, clearly they had not bought into the triplebyte process. Some seemed entirely unfamiliar with triplebyte.

    Interviewing can be a sad process. Triplebyte gave me a taste for what things could be like, but didn't give me any advantage in the application process.

    The companies triplebyte matched me with resulted in some of my worst interview experiences. Think disinterested ceos, hostile line of questioning, and a focus on my previous job experience vs things I would have liked to talk about (open source, personal projects)

  • by dabockster on 2/28/18, 10:08 PM

    As a job seeker, how is TripleByte different than the other companies that spam my email inbox with their own "exclusive" coding tests? It seems to me that when you peel back the fancy website, TripleByte is not functionally different from the hiring agencies on other job boards (cough cough, Dice) that would advertise an "exciting opportunity" with their nameless client in order to hook you into signing a contract with them. ("Hey, while you're not qualified for this role, we have others that come by our desk constantly. So how about letting us sell you to other companies?")

    EDIT: Their website layout is a classic agency layout.

    > header with giant "sign up" button

    > "top tech companies" in big print as a selling point

    > huge section with the most "famous" companies in their client pool

    > free cost (you're the product they're selling, so they're not looking out for a best fit - they're looking to get paid for placing you)

    > testimonials

    > blogroll that reads like it was built solely for SEO

  • by thecombjelly on 2/28/18, 8:50 PM

    Do programmers love numbers and algorithms so much they want to be reduced to them? Programmers are people and should be treated as such.

    Also, shouldn't we be concerned that giving one company's algorithms control over who gets hired will be too much power in too few hands? And algorithms are not neutral. The people that make the algorithms have biases and discriminations just like regular people do but at least if your company does its own hiring you can work on figuring out what those are and how to address them. How can you do that if you depend on some proprietary algorithm?

    And what about disabilities? How does your algorithm handle those? Racial bias? So many unanswerable questions.

    I have many issues with the way most companies interview but giving up that process to a proprietary algorithm seems like the worst solution. This is not news to be celebrated.

  • by montrose on 2/28/18, 8:08 PM

    This quote from the TechCrunch article was to me the most striking element of this story. They already yield double the rate of good candidates:

    ""The metric that companies care most about is what percentage of on-site interviews convert into hires, and the industry standard is 20 percent. Triplebyte’s placement rate is 40 percent," says Taggar."

  • by haaen on 2/28/18, 8:05 PM

    For anyone who thinks that Paul Graham is still a YC partner: he has retired from Y Combinator.

    https://www.ycombinator.com/people/

  • by koopuluri on 2/28/18, 10:22 PM

    This is great news. Hiring needs to be better solved.

    The current screening process provides a low signal of competence, and so companies have to rely more on credentials (degrees, previous company brands) during screening, which means that a lot of skilled people still can't get their feet in the door at companies if they don’t “look right”, and companies fight over a restricted talent pool.

    Lack of hiring data for smaller companies means they copy larger company’s interview processes, but there’s no strong forcing function to drive innovation in larger company’s hiring processes (i.e. their success could be despite a bad interviewing process - because they have a brand and offer a lot of perks, hence attracting the best talent, and so they aren’t in a “we have to fix hiring or we will die” mode).

    This also really hurts startups - who aren’t in positions to take risks with hiring, and with a lack of good evaluations, have to rely on credentials, which restricts their pool, and makes them compete with the big cos for that talent.

    Another important implication of fixing hiring is that it will introduce a powerful forcing function on higher education institutions. If students know that they can get jobs without having “traditional” credentials, but if they can pass, say TripleByte’s, or some other company’s, assessment which is more aligned with what’s required on the job, and is a signal that companies believe in, then students can use money that they would have spent on college to instead actually learn the skills that would be useful on the job.

    This movement of money out of higher education, would fund a lot more experiments in learning and education.

    I can’t stress how important I think this problem is to solve, and I’m glad companies like TripleByte, interviewing.io, are working on it. We need more companies, more approaches, more experiments in this space.

  • by austincheney on 2/28/18, 9:49 PM

    > We started Triplebyte because we were frustrated by the noise present in every step of the hiring process.

    This is largely just a software/technology problem. In all other professional industries there are means to validate a candidate's competency before they are allowed to interview for a position: licensing, required internships, legal certifications/authorizations, authorized relationships, and so forth.

    Technology doesn't have this. The big difference is that in those other professions they are using the interview to actually interview the candidate, as in the person. In software and technology the entire interview is used to gauge basic competency and even then the trust relationship is inherently broken.

    Contrary to what technologists will tell you the problem isn't the hiring process or low salaries (preposterous answer unless you live in the bay area). These are symptoms of a broken trust relationship. Hiring companies inherently do not trust the people they are interviewing as basically competent unless they have been told otherwise by somebody they know personally.

    Hiring companies shouldn't trust a candidate is minimally competent, because there is no means to a standard baseline on which competency is measured. That is the primary problem. Solve for this problem and the resulting symptoms are easily addressed by the marketplace as a matter of economics.

    ---

    The problem is very clear to see when you have two simultaneous careers: one as a software developer and a different one in an unrelated industry that has professionally addressed these concerns with required professional education and accreditation/licensing.

  • by abraham_s on 3/1/18, 5:20 AM

    I decided to comment after seeing a number of negative comments here. I went through the process a it was a positive experience for me. I ended up interviewing at 5-6 places and didn't receive an offer. I liked getting the interview feedback. The time saved in skipping the usual application process seemed worthwhile to me ( You spend 2(?) hours on the triplebyte interview. Then a short introducutory call with each company you are matched and the onsite interview). My only complaint was that I was looking for larger and my matches were all 5-50 employee companies. I guess not many large firm are using them. Overall I would recommend triplebyte for anyone who is interested in startups and who currently in a full time job search.
  • by taurath on 2/28/18, 7:44 PM

    "Evaluating" 5000 engineers a month almost seems low to me - they've been going full bore with advertising and have been on the top of reddit for the last month or two (and if I remember correctly I think I've seen them on twitter and FB). With this much spend I would have thought they'd have more candidates. Maybe thats a lot!
  • by bhuga on 2/28/18, 8:39 PM

    I had a great experience with Triplebyte as a candidate (now hired employee), but I'd love to see them expand to other categories. Remote-friendly companies is a big one, but even more important is different skill levels. Right now triplebyte is oriented around finding the best, instead of finding everyone and helping employers get a candidate whose career path matches their needs.

    Their process is fantastic. I can see them replacing first round interviews entirely at some companies if they can look for all the candidates companies need, not just the most senior.

    I'm glad to hear they're expanding.

  • by joshribakoff on 2/28/18, 11:10 PM

    I went through the process & got some attractive offers. I had mixed thoughts overall. Initially, they told me the benefit was I can avoid white boarding & on site coding challenges, however all the companies had their own white boarding or coding challenges. The hotel they put me in was in the Tenderloin, a bad part of town. I had lunch with Triple Byte & they were all very nice. Overall it was a positive experience so much so that I did not submit my urban fee/uber costs for reimbursement, seeing as I got offers on the upper end of their range & still turned them down. Going through their process has easily made me 2x as strong of a developer & helped me recognize my own worth.
  • by Alex3917 on 2/28/18, 7:52 PM

    > And we've now reached the point where our automated assessment substantially outperforms human interviewers at evaluating technical skill.

    What does this mean exactly? E.g. does the test successfully identify the people who have the best portfolios of things they’ve built previously?

  • by zitterbewegung on 2/28/18, 7:30 PM

    Anyone care to comment on how the whole Triplebyte process goes as a person who wants to be hired? I'm interested since I never got past the set of questions due to some kind of bug in the beta.
  • by aerodog on 3/1/18, 2:01 AM

    With Marissa Mayer's investing, I take it the idea is to get their $50MM valuation to $5MM over 3 years before they sell it?
  • by crabasa on 3/1/18, 6:22 AM

    Disclaimer: I am building a startup in this problem space.

    Does anyone think that social proof could work here? If 15 peers endorse Sally for React Native and those 15 people are likewise found to be credible, could such a network effect be more valuable than a coding test?

  • by lunchbreak on 3/1/18, 1:11 AM

    Do they have lots of jobs on offer? I passed the quiz and was accepted after the technical interview in late 2017 (I must say the interview was very well done and the feedback was very constructive), but they had 2 matches for me in NYC, of which neither progressed to a company interviewed. I heard of others that had a similar experience.
  • by nightsd01 on 2/28/18, 10:00 PM

    I got my current job with Triplebyte. I’m incredibly happy with how it all worked out and couldn’t recommend it enough.

    I got to interview with some pretty exciting/interesting companies.

    The only problem with Triplebyte, in my opinion, is that I don’t think they track job success AFTER the hire. I imagine this is probably a problem they’re working on. But it’s hard to build a successful recruiting company if you don’t know what happens to the employees once they actually get hired.

  • by mindhash on 3/1/18, 5:06 AM

    I hope we move towards recruiting being a culture/attitude problem and not really a skills data problem. Most jobs are repeatative and most engineers adapt. So important is to identify culture and attitude fit.

    The problem with raising the bar for interviewing engineers is the work that they end up doing isn't moving at same pace. With more frameworks, better languages and open source building stuff is getting easier

  • by wheresvic1 on 3/1/18, 1:24 PM

    While I can totally understand the need for this by hiring managers who need to get people onboard without wasting too much time, I am a little bit skeptical of being reduced to a simple number in some sort of a machine learning algorithm. Especially if this algorithm is then being used by half the companies in my area.

    I think hiring is a difficult process because we need to work with others and people are different in general.

    I have personally worked with people who started programming just because they were interested in it - they had no knowledge of algorithmic complexity but they were very open-minded, had a great perspective on the domain and were a pleasure to work with.

    This is very anecdotal of course but I sincerely hope that they would have been able to make it past the online quiz...

    (If you're thinking they should be smart enough to be able to game the quiz, then my question would be - why not just screen everyone in person then? Of course, that's not scalable and not worth the 50 million then...)

  • by quadcore on 3/1/18, 4:53 AM

    Thinking about it, I think I understand their insight now. The idea is that, even if you got triplebyte-d, the startups will pass you through their interviewing process - let's be realistic for a sec. So triblebyte is not about getting you hired, I mean, not directly. It's about something else.

    Thing is, a startup cant do like amazon and actually dive into every random applicant. It's too big of a work. So, a startup is limited and can only use recommendations in order to even think about interviewing someone.

    Now, what if a company would do the grunt work and select a few of those random applicants and submit them to the companies. That would bring a shitload of value because now startups would have a new source of relevant applications to tap in.

    I think triplebyte is actually a good investment.

  • by bitL on 2/28/18, 8:01 PM

    I'll bite: Isn't using scientific methods in HR similar to stock trading? I.e. you need to predict how well a given person would fit within a company; you can't really capture significant soft abilities like who-knows-whom, which might have significantly bigger impact on profitability of the project than any individual/technical contribution if you purely optimize for profit. You also need to take into account company's strategy, environment that is changing etc.
  • by pmuk on 2/28/18, 7:30 PM

    Has anyone on here used them from the employer side?
  • by thingsilearned on 2/28/18, 10:31 PM

    Such a great service. Recruiting with real value add for both candidates and the companies. We love Triplebyte at Chartio!
  • by cvittal on 2/28/18, 8:30 PM

    >We'll also be expanding to support engineers and companies in new locations.

    This is the most exciting thing to me. I would love to use Triplebyte to try to find a position, but relocating is just not an option for me right now.

  • by ChrisDiNicolas on 2/28/18, 10:32 PM

    I'm thinking about starting a company that is treating passing coding challenges as a 'data problem'
  • by lnnaie on 3/1/18, 2:19 PM

    let's connect that with their gene pool and there you have another way of spotting super humans. although i'm not coming from india, congrats!
  • by jasonwilk on 3/1/18, 2:24 AM

    Congrats Harj! Looking forward to this opening in LA
  • by farnsworthy on 3/1/18, 9:18 AM

    We are bought and sold, again.
  • by pankajdoharey on 3/1/18, 9:04 AM

    Marissa mayer literally ran yahoo into the ground, she has come to mean disaster.

    Marissa = Disaster. I hope she doesnt overemphasize her position as an investor and again runs an enterprise into the ground.