Can anyone confirm these instructions for building Haiku?

Development OS
#1

I have installed Haiku on a Dell, downloaded the buildtools and haiku repos and have tried to follow these instructions:

I get an error when running this command (from the page above):

./configure --cross-tools-source …/buildtools --build-cross-tools x86_64

The script runs for a long while, and then here is the final error:

cp /boot/home/Projects/Haiku/buildtools/gcc/gcc/gcc-ar.c gcc-nm.c
make[2]: cp: Is a directory
make[2]: *** [Makefile:2166: gcc-nm.c] Error 127
make[2]: Leaving directory ‘/boot/home/Projects/Haiku/haiku/generated/cross-tools-x86_64-build/gcc/gcc’
make[1]: *** [Makefile:4274: all-gcc] Error 2
make[1]: Leaving directory ‘/boot/home/Projects/Haiku/haiku/generated/cross-tools-x86_64-build/gcc’
make: *** [Makefile:908: all] Error 2
ERROR: Building gcc failed.

It would be great if someone can confirm that a fresh install of Haiku, and then following these instructions will result in a successful build. It is difficult to get started when these early steps fail before one really even gets into the project. My goal was to get past the building of Haiku so that I could then explore and experiment.

#2

I actually just finished running that exact same command and I didn’t have any issues. Did you clone the buildtools from https://review.haiku-os.org/buildtools?

Edit: Well, I created a generated/ folder first and used ../configure --build-cross-tools x86_64 --cross-tools-source ../../buildtools from it, I don’t know if that’s relevant, but I figured I should mention it

#3

That’s helpful. I did the following command from the haiku directory. I’m trying the one you mentioned now.

#4

How sad… after waiting several minutes (since my last post) the same error was produced.

When @chickfilla got it working, was there any steps you did outside of the directions given that perhaps I wouldn’t have thought to try?

#5

Unfortunately not, I followed the guide on https://www.haiku-os.org/guides/building/compiling-x86_64 and it worked on my end. Are you sure you are using a 64 bit install? If you are on 32 bit, I believe you can just do ./configure

#6

Yeah… I’m running Haiku hrev54954 x86_64

I’m doing a fresh checkout of the buildtools and haiku repos and trying again…

#7

Do you have a directory called cp in your PATH? Either cp is a directory or one of the files that cp should copy is.

#8

No, I have the haiku source and buildtools here:

/boot/home/Projects/Haiku/haiku
/boot/home/Projects/Haiku/buildtools/

I guess this is why the error messages are confusing to me.

#9

For what it is worth, when I was doing the above tests I am doing this on the bare metal of a Dell machine. Today I decided to run Haiku in VirtualBox and for some reason, following the same steps, as on the pages referenced, it was able to finish building the buildtools… but when I tried to build the nightly, it failed.

Why would I be getting different results in these types of situations? Does that help pinpoint what may be happening? The output from running these commands is like a mile long… so is there some part of it that would help in diagnosing this?

Is there anyone interested in helping me resolve this? Of course a person can’t really contribute much when they can’t move past these types of hurdles.

This is definitely a frustrating part of trying to get involved. I do realize that, due to Haiku’s totally open nature, that no one is required to help… but if someone does help, and these types of hurdles can be overcome, it would seem to me that more people would be willing to get involved to contribute. One thing I find very common in these forums is that people experience difficulties that prevent an encouraging experience. Anyway, just thought it might be valuable if I shared this.

#10

Just share the whole thing. Put it on paste.debian.net or some similar website. It will avoid rounds of you posting a part, then us asking you to post another part, and so on.

As for getting different results, it points to either you doing something differently, or the hardware or software having a problem and behaving weirdly (incompatible CPU, broken RAM, or maybe on the software side, filesystem corruption or things like that).

Without complete logs (and ideally the exact steps you used) and with no one able to reproduce the problem, there isn’t a lot we can do to help.

#11

I can appreciate the response, but I want to emphasize one basic detail:

I download a fresh latest nightly anyboot.

I create a new instance in VirtualBox, boot up and install Haiku.

I then follow the steps to get the build tools and haiku repo by copying and pasting the two commands on the relevant Haiku pages. The only modification I make is to add the depth of 10 to minimize the download.

I then follow and copy and paste the commands for making the generated directory and running the configure.

Those are the steps I take… literally copying and pasting the commands from the pages.

The two types of Haiku environments that I have tried on are both using the 64-bit images of haiku. One on bare metal dell optiplex machine, and one in a VM using VirtualBox on my Windows 10 64-bit Dell.

My basic concern is that on both machines, which have no custom configuration, I get two results, neither successful.

So, it really seems to me that this is not a good experience. I’m just replying here on my phone, so next time I’m back in my office I’ll try again and capture the output for analysis.

One of my reasons for this thread is to at least provide the feedback that by just following the published steps, I am unable to be successful. I wanted to confirm that these pages were not out of date in some way, and that if someone else tried exactly the steps on these pages that they would be successful. My thought was that it would save me from doing these steps over and over without success just to find out the steps were outdated and wrong now.

#12

Hi all, I am trying to build the haiku code. I am following the instructions given here: https://github.com/haiku/haiku/blob/master/ReadMe.Compiling.md

When I hit the command ../configure --cross-tools-source ../../buildtools --build-cross-tools x86_64. I see the following error after some time:

gcc -DHAVE_CONFIG_H -I. -I/home/saloni/haiku/haiku/buildtools/binutils/ld  -I. -I/home/saloni/haiku/haiku/buildtools/binutils/ld -I../bfd -I/home/saloni/haiku/haiku/buildtools/binutils/ld/../bfd -I/home/saloni/haiku/haiku/buildtools/binutils/ld/../include  -O2 -DENABLE_PLUGINS -DLOCALEDIR="\"/home/saloni/haiku/haiku/haiku/generated/cross-tools-x86_64/share/locale\""  -W -Wall -Wstrict-prototypes -Wmissing-prototypes -Wshadow -Wstack-usage=262144 -DELF_LIST_OPTIONS=TRUE -DELF_SHLIB_LIST_OPTIONS=TRUE -DELF_PLT_UNWIND_LIST_OPTIONS=TRUE -O2 -MT deffilep.o -MD -MP -MF .deps/deffilep.Tpo -c -o deffilep.o `test -f deffilep.c || echo /home/saloni/haiku/haiku/buildtools/binutils/ld/`deffilep.c 
gcc: error: /home/saloni/haiku/haiku/buildtools/binutils/ld/deffilep.c: No such file or directory
gcc: fatal error: no input files
compilation terminated.
Makefile:2179: recipe for target 'deffilep.o' failed
make[4]: *** [deffilep.o] Error 1
make[4]: Leaving directory '/home/saloni/haiku/haiku/haiku/generated/cross-tools-x86_64-build/binutils/ld'
Makefile:1782: recipe for target 'all-recursive' failed
make[3]: *** [all-recursive] Error 1
make[3]: Leaving directory '/home/saloni/haiku/haiku/haiku/generated/cross-tools-x86_64-build/binutils/ld'
Makefile:1057: recipe for target 'all' failed
make[2]: *** [all] Error 2
make[2]: Leaving directory '/home/saloni/haiku/haiku/haiku/generated/cross-tools-x86_64-build/binutils/ld'
Makefile:7137: recipe for target 'all-ld' failed
make[1]: *** [all-ld] Error 2
make[1]: Leaving directory '/home/saloni/haiku/haiku/haiku/generated/cross-tools-x86_64-build/binutils'
Makefile:848: recipe for target 'all' failed
make: *** [all] Error 2

I checked the https://github.com/haiku/buildtools/tree/master/binutils/ld also, in that I am not able to find the file buildtools/binutils/ld/deffilep.c as well.

Can someone please have a look into this and let me know what I may be doing wrong?

Thanks,
Saloni Garg

#13

I’m using Haiku x86_64 hrev54959 (i.e. nightly branch) for this test. This should work on Haiku R1B2. Do a ‘pkgman full-sync’ to get the latest system updates.

Ensure your folders are correct:

  1. cd ~/ (i.e. /boot/home or go to your work partition)
  2. git clone buildtools
  3. git clone haiku
  4. mkdir haiku/generated.x86_64
  5. cd haiku/generated.x86_64
  6. …/configure --cross-tools-source …/…/buildtools --build-cross-tools x86_64 :point_left:

Now, your folder levels probably caused your issue (i.e. Projects/Haiku) in the build scripting. Try to do it the exact way I posted…

Update: Build completed successfully of the Haiku hrev54960 x86_64 snapshot using Haiku hrev54959 x86_64 as the build host, platform.

#14

It seems to me you have a path problem, you should recheck where you are calling the ./configure from and where the build tools acually are.

#15

I also wanted to give an update from my original post. I’ve followed the same steps each time and been sure to update my version of Haiku to the latest each time. For the past several days, I’ve followed the same steps as I listed. These steps come from the two pages:

Getting the source

Building for x86-64

The path that I’ve been working on from the root was /boot/home/Projects

I then create a new folder called hkdev to which I checkout the source. So, the buildtools and haiku directory are checked out here:

/boot/home/Projects/hkdev/buildtools
/boot/home/Projects/hkdev/haiku

And within the haiku folder I create the generated.x86_64 directory, just as the steps indicate.

Every time I tried this on the actual hardware (not VM), I got an error during the configure step for the build tools. For some reason, today, I it was able to successfully complete the configure step for the buildtools.

Did something change between my original post and now that might have impacted this?

I will now move to the step of creating the nightly anyboot and post the results.

1 Like
#16

Here are the exact commands I’m running… I created a script to ensure I’m doing it the same each time:

#!/bin/bash

rm -rf hkdev

mkdir hkdev
cd hkdev

git clone https://review.haiku-os.org/buildtools --depth 1

git clone https://review.haiku-os.org/haiku --depth 1

cd haiku

mkdir generated.x86_64

cd generated.x86_64

../configure --cross-tools-source ../../buildtools --build-cross-tools x86_64

jam -q -j2 @nightly-anyboot

I’ve still not been able to actually complete both the buildtools and the building of the nightly… I’ll post the tail of the logs and post a URL next.

I’d be curious to know if anyone else runs this script do they get different results?

#17

Here are my errors from the two last attempts running the same script as I just posted:

http://paste.debian.net/1187532/

http://paste.debian.net/1187533/

This was done on the same machine where I am running Haiku as the main os directly on the metal.

#18

What hrev are you running? I ask so that I could try to give this a try on the same revision. I will probably use a VM though.

Looking at these two logs you get different errors. For the 32 one it seems you lack the tools to build the EFI image. I don’t personally know the details of that, whether those are supposed to be on the system, or if they should be installed before building, or if the build system is supposed to add them but failed to.

For the 33 one it seems that name resolution for eu.hpkg.haiku-os.org fails, your system cannot download some gcc system libs and then a link fails for lack of some .o files, probably from this package.

Also it is really wasteful to delete everything between each run, you really should not need to do that. Git checkouts and downloading all those packages is expensive, for both your machine and the Haiku servers. You should only need to delete all this if they get really messed up, and then really it should only be the generated directories. Nothing is touched in the actual Git checkout so again that should not be deleted between runs.

I would keep trying to build without deleting things and see if the errors are consistent. The fact that you get different errors between runs means something else is up, like flaky networking or something. Part of the confusion is that it seems things like failed package downloads don’t immediately make the build fail, when they probably should. You seem to only get build failures when the things provided by the packages that failed to download are needed by the build.

#19

Thank you very much for taking the time to look into this. My main reason for checking things out each time was because I really had no idea what might be taking place on each step of the configure and build, etc. If you suggest that I don’t need to pull down fresh repos because nothing within them (except in the generated directory) is being changed, then I’ll try that approach. I’ll at least do a pull on each repo first to make sure that I have any new changes if there are any.

Each day that I try this I pull down the latest Haiku by using the Software Updater first. The one I ran today, which would be the second file is hrev54968, x86_64.

Another reason that I was deleting everything and starting over was because I was interested in simulating the first-try experience for new users. I figured if a new user can’t follow the steps and get working results, then it is going to be very hard to attract new users who feel interested in helping on the project. I would certainly have apprehensions about inviting new users to try Haiku (as a developer) if these first steps are such a hassle to get working.

#20

Ironically this revision definitely has broken package upgrading and installing, in fact you may have trouble now upgrading from it. You may need to downgrade first to be able to get the latest nightly (if you have your previous package states), or you will need to download it manually, then install the package. This could be the reason for current building problems.

That’s totally fair. I think we should have more information about what could go wrong and what to do about it, and maybe some more details about how the build system works, and the things it needs to do (like download build packages, so there needs to be a working network connection.) Plus details like I told you that you should not need to re-download the source ever unless your Git repo gets totally messed up. Git is another thing, where maybe we just need to link to some standard documentation.

I also think it would be helpful to have some documentation about the full process to fix a bug in Haiku, from getting the source, building it, changing the code for something, rebuilding that, and then the various ways to test that changed component including some tips and tricks. Maybe we have already something like this (I would need to check) but I suspect we don’t have it all in one place where someone could follow it in a single tutorial.

I have bouts of time where I work on Haiku and then long stretches where I don’t (like a lot of people I have a job and a family and various priorities change over time.) Even though I’ve been with the project for almost 20 years on and off, I still have a little trouble getting back up to speed (plus of course things change and if you don’t keep up it can be hard to know what might be broken on a given day.)

I have tried to think of ways to make this easier, like prebuilt development VMs or something but we may have to think outside the box some. I’ve had some more crazy ideas recently related to running Haiku in the cloud and maybe a WebAssembly app which can connect to the remote app_server protocol but I don’t know how viable it is. I don’t think most developers would want to use that day to day but it might be a faster way to try things or fix something small, I don’t know. Companies like https://www.gitpod.io/ are doing some interesting things. But developing an operating system is a lot more complex than a random web app.